-- Logs begin at Tue 2021-08-24 18:36:14 UTC, end at Tue 2021-08-24 19:51:54 UTC. -- Aug 24 19:21:06.467703 dv-cinder-798198-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 19:21:06.475328 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 24 19:21:06 2021] *** Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: nodename: dv-cinder-798198-3-iscsi Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: machine: x86_64 Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: clock source: unix Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: pcre jit disabled Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: detected number of CPU cores: 4 Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: current working directory: / Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: detected binary path: /usr/bin/uwsgi-core Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: your processes number limit is 47680 Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: your memory page size is 4096 bytes Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: detected max file descriptor number: 2048 Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: lock engine: pthread robust mutexes Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: thunder lock: enabled Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 19:21:06.480309 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 24 19:21:06.523254 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: Python main interpreter initialized at 0x55d1ac8ce9c0 Aug 24 19:21:06.523254 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: python threads support enabled Aug 24 19:21:06.523254 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: your server socket listen backlog is limited to 100 connections Aug 24 19:21:06.523254 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: your mercy for graceful operations on workers is 90 seconds Aug 24 19:21:06.523681 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 19:21:06.523681 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: *** Operational MODE: preforking *** Aug 24 19:21:06.523944 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: *** uWSGI is running in multiple interpreter mode *** Aug 24 19:21:06.523944 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: spawned uWSGI master process (pid: 93735) Aug 24 19:21:06.524162 dv-cinder-798198-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 19:21:06.525323 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: spawned uWSGI worker 1 (pid: 93736, cores: 1) Aug 24 19:21:06.525323 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: spawned uWSGI worker 2 (pid: 93737, cores: 1) Aug 24 19:21:06.525323 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 19:21:08.167131 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 19:21:08.167131 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: from cryptography.utils import int_from_bytes Aug 24 19:21:08.167765 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 19:21:08.167765 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: from cryptography.utils import int_from_bytes Aug 24 19:21:08.167909 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 19:21:08.167909 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: from cryptography.utils import int_from_bytes Aug 24 19:21:08.168407 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 19:21:08.168407 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: from cryptography.utils import int_from_bytes Aug 24 19:21:10.848906 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 19:21:10.849529 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 19:21:10.849641 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 19:21:10.849951 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 19:21:10.850329 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 19:21:10.850329 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 19:21:10.850503 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 19:21:10.850592 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.850682 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 19:21:10.850883 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.851030 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 19:21:10.851199 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.851289 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 19:21:10.851514 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.851661 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.851838 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.851989 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.852144 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.852333 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.852482 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.852656 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.852797 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.852985 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.853122 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.853293 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.853388 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.853614 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.853716 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.853935 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.854035 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-798198-3-iscsi {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.854255 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.854355 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.854513 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.854608 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.854828 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.854922 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.855156 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-798198-3-iscsi {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.855246 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.855454 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.855539 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.855769 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.855863 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.856067 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.856161 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.856413 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.856594 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.856708 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.857033 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.857168 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.857328 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.857431 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.857634 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.857834 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.857951 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.858142 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.858255 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.858449 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.858583 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.858759 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.858875 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.859098 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.859197 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.859412 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.859518 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.859720 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.859817 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.860038 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.860134 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-798198-3-iscsi {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.860368 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.860484 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.860691 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.860784 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.860999 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.861098 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.861441 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-798198-3-iscsi {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.862088 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.862299 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.862409 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.862607 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.862700 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.862919 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.863092 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.863235 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.863323 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.863540 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.863627 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.863864 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.863960 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.864182 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.864299 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.864522 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.864612 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.864838 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.864934 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.865143 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.865237 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.865446 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.865540 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.865750 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.865845 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.866087 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.866214 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.866389 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.866543 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.866689 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.866816 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.866938 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.867127 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.867241 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.867446 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.867544 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.867751 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.867846 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.868055 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.868152 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.868330 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.868435 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.868643 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.868738 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.868960 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.869046 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.869277 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.869366 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.869584 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.869670 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.869836 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.869931 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.870087 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.870181 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.870406 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.870494 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.870728 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.870824 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.871034 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.871127 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.871334 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.871434 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.871634 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.871730 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.871937 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.872030 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.872243 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.872410 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.872578 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.872678 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.872884 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.872972 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.873198 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.873285 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.873534 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.873622 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.873824 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.873916 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.874127 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.874214 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.874446 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.874534 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.874760 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.874846 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.875069 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.875166 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.875383 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.875477 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.875693 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.875780 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.875993 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.876086 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.876311 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.876404 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.876615 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.876713 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.876928 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.877015 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.877293 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.877381 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.877594 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.877681 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.877841 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.877944 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.878137 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.878224 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.878436 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.878522 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.878750 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.878851 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.879049 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.879147 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.879329 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.879462 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.879632 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.879741 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.879923 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.880020 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.880223 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.880341 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.880548 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.880650 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.880849 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.880937 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.881148 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.881236 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.881446 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.881538 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.881742 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.881828 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.882041 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.882137 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.882340 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.882451 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.882642 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.882743 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.882940 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.883045 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.883243 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.883340 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.883539 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.883627 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.883839 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.883925 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.884135 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.884243 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.884463 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.884578 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.884775 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.884863 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.885081 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.885170 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.885379 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.885467 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.885680 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.885768 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.885981 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.886068 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.886280 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.886376 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.886584 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.886684 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.886883 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.886981 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.887181 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.887270 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.887481 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.887570 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.887776 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.887871 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.888075 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.888169 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.888405 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.888507 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.888707 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.888797 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.889007 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.889110 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.889307 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.889420 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.889603 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.889692 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.889901 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.889988 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.890202 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.890298 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.890501 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.890598 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.890798 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.890886 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.891092 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.891188 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.891393 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.891479 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.891689 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.891774 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.891989 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.892084 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.892303 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.892392 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.892623 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.892766 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.892938 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.893039 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.893242 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.893331 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.893549 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.893638 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.893856 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.893946 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.894159 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.894247 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.894483 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:21:10.894650 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.894820 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.894964 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.895124 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.895256 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.895433 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.895571 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.895742 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.895880 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.896062 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.896198 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.896392 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.896496 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.896702 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.896790 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.897011 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.897098 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.897322 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.897416 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.897632 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.897718 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.897943 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.898028 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.898251 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.898346 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.898560 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.898645 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.898869 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.898968 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.899175 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.899274 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.899484 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.899575 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.899798 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.899884 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.900112 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.900208 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.900439 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.900540 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.900750 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.900845 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.901066 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.901167 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.901392 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.901478 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.901709 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.901802 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.902016 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.902116 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.902332 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.902426 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.902638 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.902725 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.902944 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.903035 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.903251 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.903340 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.903561 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.903649 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.903865 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.903954 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.904169 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.904257 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.904521 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.904634 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.907176 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.907335 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.907450 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.907563 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.907675 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.907781 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.907904 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.908010 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.908010 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.908212 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.908873 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.909018 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.909151 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.909275 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.909399 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.909521 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.909646 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.909783 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.909909 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.910032 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.910162 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.910729 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.910830 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.910913 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.910993 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.911072 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.911151 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.911228 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.911317 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.911398 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.911484 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.911571 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.911652 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.911731 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.911822 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.911903 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.911982 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.912061 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.912139 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.912325 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.912412 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.912492 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.912578 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.912659 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.912739 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.912826 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.912907 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.913039 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.913124 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.913204 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.913290 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.913380 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.913461 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.913547 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.913628 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.913707 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.913786 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.913873 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.914016 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.914105 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.914323 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.914410 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.914654 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.914796 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.915046 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.915184 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.915292 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.915396 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.915597 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.915713 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.915941 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.916098 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.916208 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.916360 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.916532 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.916647 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.916839 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.916968 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.917139 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.917255 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.917463 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.917601 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.917726 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.917908 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.918043 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.918213 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.918349 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.918524 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.918658 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.918830 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.918958 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.919134 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.919263 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.919438 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.919564 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.919746 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.919880 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.920046 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.920175 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.920444 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.920612 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.920740 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.920825 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.920939 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.921036 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.921246 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.921333 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.921562 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.921655 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.921867 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.921955 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.922172 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.922259 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.922476 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.922562 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.922780 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.922869 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.923112 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.923198 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.923417 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.923511 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.923721 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.923807 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.924890 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.924982 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.925064 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.925236 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.925466 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.925560 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.925642 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.925923 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.926012 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.929299 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.929299 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.929299 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.929299 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.929299 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.929299 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.929299 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.929299 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.929907 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.929907 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.929907 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.929907 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.930190 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.930283 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.930366 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.930446 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.930526 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.930708 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.930856 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.931025 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.931163 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.931347 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.931497 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.931662 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.931815 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.931978 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.932141 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.932308 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.932516 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.932617 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.932858 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.932946 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.933182 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.933279 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.933513 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.933609 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.933820 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.933914 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.934138 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.934224 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.934446 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.934541 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.934760 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.934847 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.935067 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.935202 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.935378 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.935467 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.935685 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.935771 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.935997 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.936090 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.936338 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.936442 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.936655 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.936742 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.936971 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.937057 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.937279 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.937367 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.937599 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.937693 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.937907 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.937994 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.938217 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.938306 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.938527 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.938614 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.938834 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.938931 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.939140 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.939227 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.939450 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.939560 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.939789 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.939885 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.940098 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.940186 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.940435 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.940526 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.940741 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.940847 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.941059 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.941158 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.941368 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.941526 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.941672 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.941957 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.942046 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.942269 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.942397 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.942592 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.942864 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.943032 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.943211 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.943298 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.943533 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.943705 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.943837 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.944143 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.944230 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.944497 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.944585 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.944808 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.944910 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.945115 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.945264 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.945420 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.945692 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.945782 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.946062 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.946149 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.946371 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.946591 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.946678 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.946979 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.947075 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.947301 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.947499 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.947611 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.947882 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.947968 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.948197 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.948305 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.948545 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.948679 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.948868 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.949109 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.949198 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.949481 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.949567 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.949791 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.949985 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.950102 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.950407 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.950494 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.950714 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.950883 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.951036 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.951289 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.951387 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.951601 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.951695 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.951920 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.952012 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.952227 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.952369 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.952561 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.952655 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.952877 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.952980 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.953188 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.953460 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.953547 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.953801 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.953889 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.954117 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.954211 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.954428 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.954516 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.954740 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.954836 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.955049 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.955157 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.955385 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.955472 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.955697 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.955796 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.956018 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.956107 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.956350 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.956442 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.956664 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.956768 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.956974 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.957062 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.957276 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.957363 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.957585 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.957684 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.957894 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.957989 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.958201 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.958460 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.958547 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.958791 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.958897 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.959095 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.959182 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.959399 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.959485 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.959712 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.959801 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.960017 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.960114 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.960355 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.960446 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.960663 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.960767 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.960977 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.961066 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.961279 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.961369 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.961588 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.961685 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.961890 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.961976 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.962189 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.962276 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.962494 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.962593 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.962793 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.962891 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.963093 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.963187 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.963395 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.963483 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.963702 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.963799 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.964003 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.964097 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.964324 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.964416 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.964638 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.964725 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.964938 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.965036 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.965250 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.965346 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.965553 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.965640 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.965860 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.965951 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.966160 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.966266 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.966471 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.966557 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.966774 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.966875 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.967074 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.967170 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.967373 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.967468 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.967674 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.967764 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.967980 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.968142 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.968305 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.968396 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.968669 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.968763 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.968986 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.969076 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.969292 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.969380 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.969609 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.969696 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.969909 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.969996 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.970211 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.970297 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.970514 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.970609 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.971326 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.971420 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.971627 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.971714 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.971930 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.972024 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.972502 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.972638 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.972809 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.972909 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.973117 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.973206 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.973420 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.973507 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.973723 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.973809 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.974023 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.974122 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.974321 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.974409 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.974627 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.974721 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.974928 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.975022 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.975238 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.975332 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.975544 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.975637 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.975841 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.975939 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.976141 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.976227 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.976465 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.976564 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.976769 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.976868 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.977070 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.977158 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.977376 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.977462 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.977676 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.977766 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.977983 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.978068 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.978279 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.978364 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.978579 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.978667 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.978878 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.978968 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.979179 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.979265 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.979483 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.979571 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.979784 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.979878 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.980089 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.980176 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.980417 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.980507 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.980717 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.980803 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.981018 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.981105 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.981314 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.981449 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.981614 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.981704 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.981919 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.982021 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.982224 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.982310 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.982529 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.982616 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.982824 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.982919 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.983129 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.983224 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.983428 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.983516 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.983728 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.983867 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.984026 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.984115 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.984354 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.984445 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.984655 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.984755 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.984951 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.985047 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.985248 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.985335 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.985546 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.985650 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.985843 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.985967 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.986160 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.986256 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.987080 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.987178 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.987379 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.987465 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.987682 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.987777 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.987984 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.988073 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.988324 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.988413 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.988641 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.988728 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.988965 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.989055 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.989286 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.989372 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.989618 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.989708 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.989902 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.989990 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.990211 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.990298 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.990520 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.990614 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.990829 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.990917 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.991128 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.991215 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.991503 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.991614 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.991763 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.991849 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.992077 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.992164 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.992409 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.992515 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.992717 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.992805 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.993036 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.993123 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.993347 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.993442 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.993653 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.993740 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.993960 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.994054 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.994267 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.994364 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.994586 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.994674 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.994890 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.994977 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.995193 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.995285 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.995498 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.995584 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.995801 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.995887 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.996107 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.996194 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.996435 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.996523 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.996743 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.996890 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.997051 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.997203 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.997360 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.997515 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.997668 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.997824 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.997984 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.998188 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.998282 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.998506 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.998595 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.998823 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.998921 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.999139 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.999227 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.999444 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.999532 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.999774 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:10.999889 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.000080 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.000178 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.000407 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.000499 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.000715 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.000805 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.001026 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.001113 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.001329 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.001423 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.001675 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.001781 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.002021 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.002120 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.002332 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.002426 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.002637 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.002727 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.002944 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.003039 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.003268 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.003365 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.003575 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.003663 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.003887 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.003973 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.004191 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.004367 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.004631 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.004727 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.004939 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.005027 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.005244 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.005360 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.005552 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.005675 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.005854 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.005999 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.006151 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.006326 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.006430 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.006650 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.006754 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.006976 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.007064 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.007282 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.007370 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.007597 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.007685 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.007910 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.008005 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.008211 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.008339 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.008552 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.008647 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.008872 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.008967 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.009189 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.009278 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.009494 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.009581 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.009817 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.009954 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.010142 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.010262 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.010456 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.010552 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.010779 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.010875 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.011178 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.011265 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.011498 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.011585 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.011803 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.011910 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.012112 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.012201 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.012443 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.012545 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.012756 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.012845 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.013064 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.013151 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.013369 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.013456 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.013672 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.013767 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.013973 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.014084 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.014294 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.014443 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.014597 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.014687 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.014906 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.014996 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.015217 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.015305 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.015527 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.015623 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.015839 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.015938 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.016196 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.016323 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.016554 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.016652 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.016860 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.016950 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.017168 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.017254 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.017473 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.017588 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.017819 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.017908 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.018125 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.018214 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.018430 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.018527 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.018751 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.018838 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.019054 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.019141 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.019362 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.019461 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.019676 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.019764 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.019984 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.020071 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.020306 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.020435 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.020611 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.020711 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.020930 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.021019 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.021231 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.021331 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.021551 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.021641 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.021866 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.021968 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.022183 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.022274 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.022503 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.022600 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.022807 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.022896 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.023126 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.023216 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.023433 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.023521 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.023733 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.023821 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.024035 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.024124 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.024356 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.024456 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.024665 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.024764 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.024973 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.025073 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.025278 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.025391 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.025587 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.025697 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.025896 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.025994 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.026200 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.026298 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.026505 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.026624 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.026828 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.026917 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.027133 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.027274 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.027455 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.027596 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.027763 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.027902 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.028068 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.028202 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.028393 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.028494 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.028687 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.028784 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.028991 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.029080 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.029298 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.029388 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.029605 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.029693 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.029913 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.030000 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.030215 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.030313 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.030516 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.030604 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.030816 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.030904 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.031138 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.031227 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.031440 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.031528 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.031759 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.031853 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.032067 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.032160 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.032393 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.032485 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.032700 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.032790 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.033002 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.033092 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.033896 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.033995 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.034202 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.034303 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.034533 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.034650 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.034850 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.034949 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.035165 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.035262 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.035499 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.035723 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.035811 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.036060 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.036187 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.036459 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.036552 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.036777 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.036875 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.037090 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.037181 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.037403 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.037493 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.037715 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.037804 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.038028 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.038167 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.038340 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.038436 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.038646 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.038760 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.038954 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.039051 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.039265 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.039352 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.039582 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.039670 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.039912 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.040133 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.040253 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.040490 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.040579 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.040808 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.040931 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.041126 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.041215 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.041440 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.041528 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.041754 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.041851 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.042066 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.042155 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.042379 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.042467 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.042690 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.042787 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.043000 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.043092 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.043309 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.043398 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.043638 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.043728 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.043950 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.044044 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.044286 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.044377 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.044612 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.044702 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.044928 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.045079 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.045240 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.045351 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.045552 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.045650 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.045864 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.045953 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.046187 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.046283 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.046520 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.046606 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.046826 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.046914 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.047139 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.047239 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.047452 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.047546 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.047761 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.047856 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.048069 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.048295 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.048409 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.048619 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.048707 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.049591 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.049707 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.049901 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.049991 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.050218 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.050319 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.050531 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.050632 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.050846 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.050934 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.051168 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.051257 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.051475 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.051571 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.051782 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.051869 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.052095 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.052230 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.052432 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.052521 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.052740 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.052834 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.053065 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.053256 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.053420 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.053574 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.053662 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.053907 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.053994 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.054230 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.054334 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.054555 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.054797 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.054887 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.055151 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.055251 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.055468 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.055562 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.055776 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.055862 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.056079 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.056175 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.056411 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.056515 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.056722 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.056811 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.057026 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.057132 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.057342 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.057433 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.057647 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.057737 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.057951 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.058047 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.058262 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.058367 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.058567 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.058670 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.058888 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.059096 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.059202 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.059442 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.059550 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.059773 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.059870 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.060084 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.060172 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.060412 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.060504 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.060742 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.060849 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.061046 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.061151 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.061347 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.061435 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.061652 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.061768 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.061953 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.062040 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.062268 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.062570 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.062872 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.063069 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.063166 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.063394 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.063493 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.063716 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.063805 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.064037 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.064133 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.064361 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.064470 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.064691 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.064845 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.065014 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.065118 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.065318 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.065418 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.065615 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.065713 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.065914 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.066003 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.066221 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.066316 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.066528 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.066857 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.067164 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.067337 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.067472 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.067655 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.067790 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.067972 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.068103 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.068308 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.068459 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.068631 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.068776 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.069034 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.069225 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.069430 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.069580 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.069784 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.069935 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.070127 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.070259 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.070443 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.070596 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.070949 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.071106 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.071257 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.071459 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.071632 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.071763 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.071907 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.072052 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.072191 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.072376 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.072507 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.072644 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.072835 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.072991 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.073150 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.073304 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.073464 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.073614 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.073764 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.073906 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.074076 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.074211 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.074389 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.074522 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.074701 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.074934 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.075081 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.075268 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.075376 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.075607 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.075720 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.075918 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.076022 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.076233 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.076355 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.076584 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.076689 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.076890 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.076991 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.077193 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.077288 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.077516 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.077605 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.077824 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.077912 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.078135 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.078221 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.078440 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.078529 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.078749 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.078841 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.079054 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.079149 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.079360 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.079455 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.079669 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.079758 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.079977 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.080081 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.080333 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.080433 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.080651 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.080762 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.080959 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.081082 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.081296 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.081392 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.081614 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.081702 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.081930 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.082026 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.082243 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.082332 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.082558 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.082659 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.082866 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.082963 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.083174 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.083262 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.083479 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.083578 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.083787 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.083878 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.084100 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.084188 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.084451 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.084555 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.084766 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.084857 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.085072 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.085177 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.085426 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.085513 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.085738 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.085846 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.086053 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.086142 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.086388 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.086476 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.086694 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.086782 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.087011 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.087100 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.087322 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.087417 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.087630 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.087745 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.087942 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.088034 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.088248 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.088375 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.088594 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.088683 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.088912 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.088999 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.089225 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.089323 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.089554 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.089640 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.089859 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.089956 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.090164 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.090256 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.090468 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.090557 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.090778 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.090865 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.091090 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.091181 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.091404 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.091499 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.091722 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.091809 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.092033 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.092124 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.092360 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.092451 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.092671 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.092770 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.092993 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.093089 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.093308 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.093417 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.093621 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.093729 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.093929 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.094032 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.094251 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.094338 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.094558 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.094656 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.094863 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.094950 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.095173 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.095267 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.095476 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.095576 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.096329 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.096445 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.096638 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.096727 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.096960 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.097050 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.097534 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.097633 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.097837 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.097929 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.098159 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.098249 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.098473 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.098561 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.098789 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.098884 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.099146 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.099241 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.099407 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.099495 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.099684 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93737) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 19:21:11.099799 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.100027 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.100358 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.100669 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.100978 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.101293 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.101607 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.101929 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.102252 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.102573 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.102896 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.103240 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.103550 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.103894 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.104219 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:21:11.104484 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93736) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 19:21:11.122439 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG oslo_db.sqlalchemy.engines [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:21:11.127362 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_db.sqlalchemy.engines [None req-1434f7cd-b1e8-4cf3-a9a6-6b7d1e036822 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:21:11.199005 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.context [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9aa87762-c658-4c0f-874d-57bbc1863216(cell1) {{(pid=93737) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 19:21:11.203195 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG oslo_concurrency.lockutils [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:21:11.203314 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.context [None req-1434f7cd-b1e8-4cf3-a9a6-6b7d1e036822 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9aa87762-c658-4c0f-874d-57bbc1863216(cell1) {{(pid=93736) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 19:21:11.204818 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG oslo_concurrency.lockutils [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:21:11.206145 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG oslo_concurrency.lockutils [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:21:11.208083 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG oslo_concurrency.lockutils [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93737) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:21:11.209087 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-1434f7cd-b1e8-4cf3-a9a6-6b7d1e036822 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:21:11.210732 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-1434f7cd-b1e8-4cf3-a9a6-6b7d1e036822 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:21:11.211526 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-1434f7cd-b1e8-4cf3-a9a6-6b7d1e036822 None None] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:21:11.213609 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-1434f7cd-b1e8-4cf3-a9a6-6b7d1e036822 None None] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:21:11.220344 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG oslo_db.sqlalchemy.engines [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:21:11.222599 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG oslo_db.sqlalchemy.engines [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:21:11.229840 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_db.sqlalchemy.engines [None req-1434f7cd-b1e8-4cf3-a9a6-6b7d1e036822 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:21:11.232036 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_db.sqlalchemy.engines [None req-1434f7cd-b1e8-4cf3-a9a6-6b7d1e036822 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:21:11.575908 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG oslo_db.sqlalchemy.engines [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93737) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:21:11.582735 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_db.sqlalchemy.engines [None req-1434f7cd-b1e8-4cf3-a9a6-6b7d1e036822 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93736) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:21:12.009103 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: WARNING keystonemiddleware.auth_token [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 19:21:12.015560 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: WARNING keystonemiddleware.auth_token [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 19:21:12.125368 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: WARNING keystonemiddleware.auth_token [None req-1434f7cd-b1e8-4cf3-a9a6-6b7d1e036822 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 19:21:12.131805 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: WARNING keystonemiddleware.auth_token [None req-1434f7cd-b1e8-4cf3-a9a6-6b7d1e036822 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 19:21:12.387642 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: WARNING keystonemiddleware.auth_token [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 19:21:12.393144 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: WARNING keystonemiddleware.auth_token [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 19:21:12.398397 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1ac8ce9c0 pid: 93737 (default app) Aug 24 19:21:12.400707 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:21:12.401956 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001960 Aug 24 19:21:12.402376 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 789 bytes} [Tue Aug 24 19:21:12 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:21:12.472473 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: WARNING keystonemiddleware.auth_token [None req-1434f7cd-b1e8-4cf3-a9a6-6b7d1e036822 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 19:21:12.477577 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: WARNING keystonemiddleware.auth_token [None req-1434f7cd-b1e8-4cf3-a9a6-6b7d1e036822 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 19:21:12.482830 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d1ac8ce9c0 pid: 93736 (default app) Aug 24 19:22:36.247664 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:22:36.248694 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 24 19:22:36.250430 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 24 19:22:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:22:36.697912 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-33268c0a-0304-44a5-8b79-186f8e2a81f3 admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:22:36.727729 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-33268c0a-0304-44a5-8b79-186f8e2a81f3 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.471069 Aug 24 19:22:36.732320 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Aug 24 19:22:36 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:22:38.945783 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:22:38.946804 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-f974e486-dc54-4628-8aef-8d811ff2d1a3 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001754 Aug 24 19:22:38.947239 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 24 19:22:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:22:39.009266 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-c53d90bf-d9b9-43c3-b748-802d9d434bd4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "disk": 1, "ram": 256, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:22:39.028057 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:22:39.028057 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: warnings.warn(msg) Aug 24 19:22:39.199744 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-c53d90bf-d9b9-43c3-b748-802d9d434bd4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.244716 Aug 24 19:22:39.200673 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 24 19:22:38 2021] POST /compute/v2.1/flavors => generated 407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:22:39.422087 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-4dc9e725-8098-4132-95ff-102f6ed0b451 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:22:39.424335 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:22:39.424335 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: warnings.warn(msg) Aug 24 19:22:39.537172 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-4dc9e725-8098-4132-95ff-102f6ed0b451 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.328107 Aug 24 19:22:39.544556 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 24 19:22:39 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:22:41.770979 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-c53d90bf-d9b9-43c3-b748-802d9d434bd4 admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:22:41.772615 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-c53d90bf-d9b9-43c3-b748-802d9d434bd4 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002283 Aug 24 19:22:41.773255 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 24 19:22:41 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:22:41.905950 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-a1a47af3-4c05-4c5b-8b6c-5f59bf23bb73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "name": "ds512M", "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:22:41.924017 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:22:41.924017 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: warnings.warn(msg) Aug 24 19:22:42.069733 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-a1a47af3-4c05-4c5b-8b6c-5f59bf23bb73 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.289956 Aug 24 19:22:42.070403 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 24 19:22:41 2021] POST /compute/v2.1/flavors => generated 404 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:22:42.083353 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-36fe786a-40ca-4061-941f-fef85a7bef46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:22:42.084879 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:22:42.084879 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: warnings.warn(msg) Aug 24 19:22:42.250510 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-36fe786a-40ca-4061-941f-fef85a7bef46 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.170979 Aug 24 19:22:42.251094 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 24 19:22:42 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:22:44.465365 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-a1a47af3-4c05-4c5b-8b6c-5f59bf23bb73 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:22:44.467022 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-a1a47af3-4c05-4c5b-8b6c-5f59bf23bb73 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002393 Aug 24 19:22:44.467446 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 24 19:22:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:22:44.527348 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-c9cf5d84-cd0c-4b35-92b3-6907d719d67c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "name": "ds1G", "swap": 0, "vcpus": 1}} {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:22:44.609285 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-c9cf5d84-cd0c-4b35-92b3-6907d719d67c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134656 Aug 24 19:22:44.610477 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 24 19:22:44 2021] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:22:44.623868 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-6a8cfd7b-01f8-4aeb-9177-58c63e32290d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:22:44.712176 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-6a8cfd7b-01f8-4aeb-9177-58c63e32290d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092690 Aug 24 19:22:44.712783 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 24 19:22:44 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:22:46.969894 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-c9cf5d84-cd0c-4b35-92b3-6907d719d67c admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:22:46.977108 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-c9cf5d84-cd0c-4b35-92b3-6907d719d67c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 24 19:22:46.977108 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 24 19:22:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:22:47.040193 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-1d6aa294-f341-4f5d-b9bd-af831f1b7f14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "rxtx_factor": 1.0}} {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:22:47.134468 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-1d6aa294-f341-4f5d-b9bd-af831f1b7f14 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.155680 Aug 24 19:22:47.135045 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 24 19:22:46 2021] POST /compute/v2.1/flavors => generated 404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:22:47.148072 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-06613cea-ff3e-4119-b000-e9f2b3af4f74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:22:47.223203 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-06613cea-ff3e-4119-b000-e9f2b3af4f74 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079366 Aug 24 19:22:47.223977 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 24 19:22:47 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:22:49.408028 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-1d6aa294-f341-4f5d-b9bd-af831f1b7f14 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:22:49.409067 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-1d6aa294-f341-4f5d-b9bd-af831f1b7f14 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 24 19:22:49.409707 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 24 19:22:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:22:49.471160 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-f82c26b2-4a46-4680-9298-4d6ec8efec3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "disk": 20, "name": "ds4G"}} {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:22:49.552496 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-f82c26b2-4a46-4680-9298-4d6ec8efec3b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.136515 Aug 24 19:22:49.553162 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 24 19:22:49 2021] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:22:49.565854 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-b08feeba-2bd9-43ce-a08d-48bdefc5c296 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:22:49.660174 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-b08feeba-2bd9-43ce-a08d-48bdefc5c296 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098281 Aug 24 19:22:49.661106 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Aug 24 19:22:49 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:22:51.912470 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-f82c26b2-4a46-4680-9298-4d6ec8efec3b admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:22:51.912470 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-f82c26b2-4a46-4680-9298-4d6ec8efec3b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 24 19:22:51.912470 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 24 19:22:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:22:51.988740 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-d2f4a55f-8edd-43af-aa32-557b5ab1e60d admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:22:52.012246 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-d2f4a55f-8edd-43af-aa32-557b5ab1e60d admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.095287 Aug 24 19:22:52.012817 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Aug 24 19:22:51 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:22:54.536273 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-f82c26b2-4a46-4680-9298-4d6ec8efec3b admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:22:54.537339 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-f82c26b2-4a46-4680-9298-4d6ec8efec3b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Aug 24 19:22:54.537755 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 24 19:22:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:22:54.608709 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-d32eb9b5-493e-43ba-b6c9-3801c7e72447 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "ram": 512, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true}} {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:22:54.725780 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-d32eb9b5-493e-43ba-b6c9-3801c7e72447 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.181160 Aug 24 19:22:54.726345 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 24 19:22:54 2021] POST /compute/v2.1/flavors => generated 402 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:22:54.739045 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-754220d1-9d24-46b8-8be1-9caf29fad8cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:22:54.818951 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-754220d1-9d24-46b8-8be1-9caf29fad8cb admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083840 Aug 24 19:22:54.819569 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 24 19:22:54 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:22:57.555194 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-d32eb9b5-493e-43ba-b6c9-3801c7e72447 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:22:57.556572 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-d32eb9b5-493e-43ba-b6c9-3801c7e72447 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001862 Aug 24 19:22:57.557127 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 24 19:22:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:22:57.621677 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-fc949e4a-be4a-44de-af59-269fc8ede1c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "vcpus": 1}} {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:22:57.730686 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-fc949e4a-be4a-44de-af59-269fc8ede1c8 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.167035 Aug 24 19:22:57.731250 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 24 19:22:57 2021] POST /compute/v2.1/flavors => generated 405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:22:57.743607 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-99d41e04-27d6-484b-a70a-fc55018245ff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:22:57.837975 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-99d41e04-27d6-484b-a70a-fc55018245ff admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097923 Aug 24 19:22:57.838980 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 24 19:22:57 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:23:00.046388 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-fc949e4a-be4a-44de-af59-269fc8ede1c8 admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:00.047404 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-fc949e4a-be4a-44de-af59-269fc8ede1c8 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Aug 24 19:23:00.047807 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 24 19:23:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:23:00.106572 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-ee9c6dca-24e1-4909-870c-d59ac9d3fba9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:23:00.187168 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-ee9c6dca-24e1-4909-870c-d59ac9d3fba9 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.131974 Aug 24 19:23:00.187707 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 24 19:23:00 2021] POST /compute/v2.1/flavors => generated 406 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:23:00.200744 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-3241174b-4884-41cb-9b97-1498eddf2fe4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:23:00.314141 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-3241174b-4884-41cb-9b97-1498eddf2fe4 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117099 Aug 24 19:23:00.314720 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 24 19:23:00 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:23:02.535220 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-ee9c6dca-24e1-4909-870c-d59ac9d3fba9 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:02.536397 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-ee9c6dca-24e1-4909-870c-d59ac9d3fba9 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Aug 24 19:23:02.536798 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 24 19:23:02 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:23:02.596883 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-8c7b08ff-95cf-4582-a668-330fe73311e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "name": "m1.large", "ram": 8192}} {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:23:02.682129 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-8c7b08ff-95cf-4582-a668-330fe73311e0 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.138772 Aug 24 19:23:02.682975 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 24 19:23:02 2021] POST /compute/v2.1/flavors => generated 405 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:23:02.696106 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-c166996e-d079-46ea-85ce-d2d90eabb65c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:23:02.779482 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-c166996e-d079-46ea-85ce-d2d90eabb65c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086966 Aug 24 19:23:02.780364 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 24 19:23:02 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:23:04.999784 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-8c7b08ff-95cf-4582-a668-330fe73311e0 admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:05.001066 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-8c7b08ff-95cf-4582-a668-330fe73311e0 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001733 Aug 24 19:23:05.001803 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 24 19:23:04 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:23:05.087282 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-30c275bd-55b6-46ae-a277-dde09005d499 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:23:06.041183 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-30c275bd-55b6-46ae-a277-dde09005d499 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.032677 Aug 24 19:23:06.049417 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Aug 24 19:23:05 2021] POST /compute/v2.1/flavors => generated 408 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:23:06.055012 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-640f3661-0b97-42db-890d-3fdc0971025c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:23:06.167828 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-640f3661-0b97-42db-890d-3fdc0971025c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116367 Aug 24 19:23:06.168556 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Aug 24 19:23:06 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:23:45.213685 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-30c275bd-55b6-46ae-a277-dde09005d499 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:45.214681 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-30c275bd-55b6-46ae-a277-dde09005d499 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 24 19:23:45.215070 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 24 19:23:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:23:45.272950 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-17cbad14-7b76-46e9-aeda-c8da04224520 admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:45.290258 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-17cbad14-7b76-46e9-aeda-c8da04224520 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068197 Aug 24 19:23:45.290792 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Aug 24 19:23:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:23:46.697181 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-30c275bd-55b6-46ae-a277-dde09005d499 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:46.698174 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-30c275bd-55b6-46ae-a277-dde09005d499 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 24 19:23:46.698563 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1075 bytes} [Tue Aug 24 19:23:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:23:46.887065 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-95767da3-8769-4457-90f8-1e5e66fa7145 admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:46.892476 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.wsgi [None req-95767da3-8769-4457-90f8-1e5e66fa7145 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 19:23:46.893037 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-95767da3-8769-4457-90f8-1e5e66fa7145 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:23:46.893831 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-95767da3-8769-4457-90f8-1e5e66fa7145 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.058292 Aug 24 19:23:46.894329 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1191 bytes} [Tue Aug 24 19:23:46 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 19:23:46.903967 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-2fdc1876-9994-4f55-b647-4c2f7b91a4e4 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:47.006618 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-2fdc1876-9994-4f55-b647-4c2f7b91a4e4 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.029021 Aug 24 19:23:47.006618 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1211 bytes} [Tue Aug 24 19:23:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:23:47.006938 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-6f31d3ac-9bfb-4f7b-ac53-cf34eb6a214e admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:47.006938 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-6f31d3ac-9bfb-4f7b-ac53-cf34eb6a214e admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.027092 Aug 24 19:23:47.006938 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1211 bytes} [Tue Aug 24 19:23:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:23:47.007211 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-b27f0e57-82b4-4a5b-8eb8-2b09f0103a8d admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:47.007211 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.wsgi [None req-b27f0e57-82b4-4a5b-8eb8-2b09f0103a8d admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 19:23:47.007211 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-b27f0e57-82b4-4a5b-8eb8-2b09f0103a8d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:23:47.007211 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-b27f0e57-82b4-4a5b-8eb8-2b09f0103a8d admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.011169 Aug 24 19:23:47.007211 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1191 bytes} [Tue Aug 24 19:23:46 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 19:23:48.341000 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-6f31d3ac-9bfb-4f7b-ac53-cf34eb6a214e admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:48.341992 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-6f31d3ac-9bfb-4f7b-ac53-cf34eb6a214e admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 24 19:23:48.342381 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1075 bytes} [Tue Aug 24 19:23:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:23:48.538420 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-49bc2049-e25f-485a-a716-66e7ebdac99c admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:48.545489 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.wsgi [None req-49bc2049-e25f-485a-a716-66e7ebdac99c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 19:23:48.546043 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-49bc2049-e25f-485a-a716-66e7ebdac99c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:23:48.546820 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-49bc2049-e25f-485a-a716-66e7ebdac99c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.059377 Aug 24 19:23:48.547319 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1191 bytes} [Tue Aug 24 19:23:48 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 19:23:48.557946 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-97283d51-6806-4c57-943b-7e2fa116a2a4 admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:48.571611 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-97283d51-6806-4c57-943b-7e2fa116a2a4 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017853 Aug 24 19:23:48.572129 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1211 bytes} [Tue Aug 24 19:23:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:23:48.582442 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-1f129a30-6e15-41cb-8616-dc566e7def74 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:48.596057 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-1f129a30-6e15-41cb-8616-dc566e7def74 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017083 Aug 24 19:23:48.596607 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1211 bytes} [Tue Aug 24 19:23:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:23:48.606217 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-4e420914-1990-446d-8b38-a1b581d32a70 admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:48.611363 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.wsgi [None req-4e420914-1990-446d-8b38-a1b581d32a70 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 19:23:48.611936 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-4e420914-1990-446d-8b38-a1b581d32a70 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:23:48.612743 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-4e420914-1990-446d-8b38-a1b581d32a70 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010004 Aug 24 19:23:48.613227 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1191 bytes} [Tue Aug 24 19:23:48 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 19:23:49.971668 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-1f129a30-6e15-41cb-8616-dc566e7def74 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:49.972678 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-1f129a30-6e15-41cb-8616-dc566e7def74 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 24 19:23:49.973067 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1075 bytes} [Tue Aug 24 19:23:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:23:50.174940 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-a4e301a9-a5df-451a-84fb-d705cf5eb467 admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:50.180534 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.wsgi [None req-a4e301a9-a5df-451a-84fb-d705cf5eb467 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 19:23:50.181130 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-a4e301a9-a5df-451a-84fb-d705cf5eb467 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93736) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:23:50.181886 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-a4e301a9-a5df-451a-84fb-d705cf5eb467 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.058438 Aug 24 19:23:50.182392 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1194 bytes} [Tue Aug 24 19:23:50 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 19:23:50.192621 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-863029ee-bbbf-4450-a3d6-568e623d18af admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:50.206901 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-863029ee-bbbf-4450-a3d6-568e623d18af admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017801 Aug 24 19:23:50.207443 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1211 bytes} [Tue Aug 24 19:23:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:23:50.217706 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-32b84be3-781e-47b8-bd22-93ddaf46a4db admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:50.231088 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-32b84be3-781e-47b8-bd22-93ddaf46a4db admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.016876 Aug 24 19:23:50.231648 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1211 bytes} [Tue Aug 24 19:23:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:23:50.241571 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-475946f9-ca64-4441-917f-24f3f260a877 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:50.246880 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.wsgi [None req-475946f9-ca64-4441-917f-24f3f260a877 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 19:23:50.247433 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-475946f9-ca64-4441-917f-24f3f260a877 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93737) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:23:50.248202 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-475946f9-ca64-4441-917f-24f3f260a877 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.010195 Aug 24 19:23:50.248797 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1194 bytes} [Tue Aug 24 19:23:50 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 24 19:23:51.580409 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-32b84be3-781e-47b8-bd22-93ddaf46a4db admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:51.581410 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-32b84be3-781e-47b8-bd22-93ddaf46a4db admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 24 19:23:51.581803 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1075 bytes} [Tue Aug 24 19:23:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:23:51.772396 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-c3293b1c-0308-4ae3-9d74-ca4a78041f0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:23:51.854865 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-c3293b1c-0308-4ae3-9d74-ca4a78041f0b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.133292 Aug 24 19:23:51.855332 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1236 bytes} [Tue Aug 24 19:23:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:23:53.193444 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-32b84be3-781e-47b8-bd22-93ddaf46a4db admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:53.194441 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-32b84be3-781e-47b8-bd22-93ddaf46a4db admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Aug 24 19:23:53.194833 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1075 bytes} [Tue Aug 24 19:23:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:23:53.388454 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-aceb5121-7dc8-46a3-acf1-17e7150a23a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:23:53.500761 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-aceb5121-7dc8-46a3-acf1-17e7150a23a0 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.165374 Aug 24 19:23:53.501309 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1236 bytes} [Tue Aug 24 19:23:53 2021] POST /compute/v2.1/flavors => generated 405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:23:54.835083 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-32b84be3-781e-47b8-bd22-93ddaf46a4db admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:54.836100 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-32b84be3-781e-47b8-bd22-93ddaf46a4db admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 24 19:23:54.836520 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1075 bytes} [Tue Aug 24 19:23:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:23:55.029383 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-62fd6448-5b5e-499c-8232-c25dc665143d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:23:55.098136 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-62fd6448-5b5e-499c-8232-c25dc665143d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.119422 Aug 24 19:23:55.098666 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1236 bytes} [Tue Aug 24 19:23:54 2021] POST /compute/v2.1/flavors => generated 407 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:23:56.470234 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-32b84be3-781e-47b8-bd22-93ddaf46a4db admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:56.471229 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-32b84be3-781e-47b8-bd22-93ddaf46a4db admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 24 19:23:56.471618 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1075 bytes} [Tue Aug 24 19:23:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:23:56.664018 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-8c4779c4-bc9b-436b-8c02-819cdc113f10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:23:56.743068 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-8c4779c4-bc9b-436b-8c02-819cdc113f10 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.131144 Aug 24 19:23:56.743606 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1236 bytes} [Tue Aug 24 19:23:56 2021] POST /compute/v2.1/flavors => generated 409 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:23:58.080491 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-32b84be3-781e-47b8-bd22-93ddaf46a4db admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:58.081482 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-32b84be3-781e-47b8-bd22-93ddaf46a4db admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 24 19:23:58.081869 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1075 bytes} [Tue Aug 24 19:23:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:23:58.277627 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-a2e06604-5e43-454e-9b48-3244378ad23f admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:23:58.297167 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-a2e06604-5e43-454e-9b48-3244378ad23f admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.075616 Aug 24 19:23:58.297701 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1203 bytes} [Tue Aug 24 19:23:58 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:24:43.471031 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-32b84be3-781e-47b8-bd22-93ddaf46a4db admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:24:43.472024 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-32b84be3-781e-47b8-bd22-93ddaf46a4db admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 24 19:24:43.472462 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 931 bytes} [Tue Aug 24 19:24:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:24:43.533137 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-da87bf3c-265c-4883-9ee0-e29e218c9330 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:24:43.552164 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-da87bf3c-265c-4883-9ee0-e29e218c9330 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073229 Aug 24 19:24:43.552795 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Aug 24 19:24:43 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:24:43.575944 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-419f575a-b4f6-4eb4-90b5-f1d7597467af admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:24:43.583878 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-419f575a-b4f6-4eb4-90b5-f1d7597467af admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012005 Aug 24 19:24:43.586963 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1283 bytes} [Tue Aug 24 19:24:43 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:24:43.596613 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-ab625b82-db84-4d80-8623-8b2090444d1d admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:24:43.604542 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-ab625b82-db84-4d80-8623-8b2090444d1d admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011526 Aug 24 19:24:43.605060 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1286 bytes} [Tue Aug 24 19:24:43 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:24:43.616835 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-8f3ffb8e-154d-490d-9327-4d4377317a47 admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:24:43.625106 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-8f3ffb8e-154d-490d-9327-4d4377317a47 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011843 Aug 24 19:24:43.625625 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1286 bytes} [Tue Aug 24 19:24:43 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:24:43.638490 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-1184fead-7baf-45a3-adff-2a862a6464a1 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:24:43.646189 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-1184fead-7baf-45a3-adff-2a862a6464a1 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012216 Aug 24 19:24:43.646700 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1283 bytes} [Tue Aug 24 19:24:43 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:26:33.284862 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-087f4581-62af-403c-b00b-2411f8edc54a tempest-verify_tempest_config-2123741512 tempest-verify_tempest_config-2123741512-project] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:26:33.286826 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-087f4581-62af-403c-b00b-2411f8edc54a tempest-verify_tempest_config-2123741512 tempest-verify_tempest_config-2123741512-project] 10.222.0.59 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.109120 Aug 24 19:26:33.287360 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 34/69] 10.222.0.59 () {58 vars in 1134 bytes} [Tue Aug 24 19:26:33 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:28:07.253690 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-1184fead-7baf-45a3-adff-2a862a6464a1 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:28:07.254762 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-1184fead-7baf-45a3-adff-2a862a6464a1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Aug 24 19:28:07.255149 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 36/70] 10.222.0.59 () {56 vars in 1075 bytes} [Tue Aug 24 19:28:07 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:28:07.510298 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-05fb926d-3efe-429d-8bb9-dd4301844439 admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:28:07.514680 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:28:07.514680 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: warnings.warn(msg) Aug 24 19:28:07.514680 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-05fb926d-3efe-429d-8bb9-dd4301844439 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:28:07.514680 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-05fb926d-3efe-429d-8bb9-dd4301844439 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:28:07.515305 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-05fb926d-3efe-429d-8bb9-dd4301844439 admin admin] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:28:07.516506 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-05fb926d-3efe-429d-8bb9-dd4301844439 admin admin] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:28:07.550800 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-05fb926d-3efe-429d-8bb9-dd4301844439 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.152128 Aug 24 19:28:07.551375 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 35/71] 10.222.0.59 () {60 vars in 1194 bytes} [Tue Aug 24 19:28:07 2021] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:28:08.939033 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-1184fead-7baf-45a3-adff-2a862a6464a1 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:28:08.940063 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-1184fead-7baf-45a3-adff-2a862a6464a1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003236 Aug 24 19:28:08.940708 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 37/72] 10.222.0.59 () {56 vars in 1075 bytes} [Tue Aug 24 19:28:08 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:28:09.135774 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-da00af02-f9f2-41fa-a58b-e9f096b10c93 admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:28:09.136948 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:28:09.136948 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: warnings.warn(msg) Aug 24 19:28:09.138482 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-da00af02-f9f2-41fa-a58b-e9f096b10c93 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:28:09.138925 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-da00af02-f9f2-41fa-a58b-e9f096b10c93 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:28:09.139705 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-da00af02-f9f2-41fa-a58b-e9f096b10c93 admin admin] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:28:09.140212 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-da00af02-f9f2-41fa-a58b-e9f096b10c93 admin admin] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:28:09.164751 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-da00af02-f9f2-41fa-a58b-e9f096b10c93 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.083024 Aug 24 19:28:09.165316 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 36/73] 10.222.0.59 () {60 vars in 1194 bytes} [Tue Aug 24 19:28:09 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:28:20.954762 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-1184fead-7baf-45a3-adff-2a862a6464a1 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:28:20.956090 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-1184fead-7baf-45a3-adff-2a862a6464a1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001700 Aug 24 19:28:20.956524 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 38/74] 10.222.0.59 () {56 vars in 1075 bytes} [Tue Aug 24 19:28:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:28:21.155830 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-5366eaf8-fe30-499d-933f-cd8ca384865a admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:28:21.162892 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:28:21.162892 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: warnings.warn(msg) Aug 24 19:28:21.162892 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-5366eaf8-fe30-499d-933f-cd8ca384865a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:28:21.162892 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-5366eaf8-fe30-499d-933f-cd8ca384865a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:28:21.162892 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-5366eaf8-fe30-499d-933f-cd8ca384865a admin admin] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:28:21.162892 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-5366eaf8-fe30-499d-933f-cd8ca384865a admin admin] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:28:21.181236 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-5366eaf8-fe30-499d-933f-cd8ca384865a admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.077749 Aug 24 19:28:21.181790 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 37/75] 10.222.0.59 () {60 vars in 1194 bytes} [Tue Aug 24 19:28:21 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:28:22.531731 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: DEBUG nova.api.openstack.wsgi [None req-1184fead-7baf-45a3-adff-2a862a6464a1 admin admin] Calling method '>' {{(pid=93737) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:28:22.532762 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: INFO nova.api.openstack.requestlog [None req-1184fead-7baf-45a3-adff-2a862a6464a1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 24 19:28:22.533185 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: [pid: 93737|app: 0|req: 39/76] 10.222.0.59 () {56 vars in 1075 bytes} [Tue Aug 24 19:28:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:28:22.723722 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG nova.api.openstack.wsgi [None req-e1dec58f-2754-4318-8939-fa6c932496f7 admin admin] Calling method '>' {{(pid=93736) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:28:22.725087 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:28:22.725087 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: warnings.warn(msg) Aug 24 19:28:22.726358 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-e1dec58f-2754-4318-8939-fa6c932496f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:28:22.726792 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-e1dec58f-2754-4318-8939-fa6c932496f7 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:28:22.727566 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-e1dec58f-2754-4318-8939-fa6c932496f7 admin admin] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:28:22.727988 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: DEBUG oslo_concurrency.lockutils [None req-e1dec58f-2754-4318-8939-fa6c932496f7 admin admin] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93736) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:28:22.749141 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: INFO nova.api.openstack.requestlog [None req-e1dec58f-2754-4318-8939-fa6c932496f7 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.076122 Aug 24 19:28:22.749621 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: [pid: 93736|app: 0|req: 38/77] 10.222.0.59 () {60 vars in 1194 bytes} [Tue Aug 24 19:28:22 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:29:19.099454 dv-cinder-798198-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 19:29:19.100136 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: Tue Aug 24 19:29:19 2021 - graceful shutdown triggered... Aug 24 19:29:19.101141 dv-cinder-798198-3-iscsi devstack@n-api.service[93736]: Gracefully killing worker 1 (pid: 93736)... Aug 24 19:29:19.101668 dv-cinder-798198-3-iscsi devstack@n-api.service[93737]: Gracefully killing worker 2 (pid: 93737)... Aug 24 19:29:20.100954 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: worker 1 buried after 1 seconds Aug 24 19:29:20.100954 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: worker 2 buried after 1 seconds Aug 24 19:29:20.102154 dv-cinder-798198-3-iscsi devstack@n-api.service[93735]: goodbye to uWSGI. Aug 24 19:29:20.103054 dv-cinder-798198-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 19:29:20.103607 dv-cinder-798198-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 19:29:20.106430 dv-cinder-798198-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 19:29:20.115491 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 19:29:20.117993 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 24 19:29:20 2021] *** Aug 24 19:29:20.117993 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 19:29:20.117993 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 19:29:20.117993 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: nodename: dv-cinder-798198-3-iscsi Aug 24 19:29:20.117993 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: machine: x86_64 Aug 24 19:29:20.117993 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: clock source: unix Aug 24 19:29:20.117993 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: pcre jit disabled Aug 24 19:29:20.117993 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: detected number of CPU cores: 4 Aug 24 19:29:20.117993 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: current working directory: / Aug 24 19:29:20.117993 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: detected binary path: /usr/bin/uwsgi-core Aug 24 19:29:20.118780 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: your processes number limit is 47680 Aug 24 19:29:20.118780 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: your memory page size is 4096 bytes Aug 24 19:29:20.118780 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: detected max file descriptor number: 2048 Aug 24 19:29:20.118780 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: lock engine: pthread robust mutexes Aug 24 19:29:20.118780 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: thunder lock: enabled Aug 24 19:29:20.118780 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 19:29:20.118780 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 24 19:29:20.165041 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: Python main interpreter initialized at 0x555dac7d09c0 Aug 24 19:29:20.165041 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: python threads support enabled Aug 24 19:29:20.165041 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: your server socket listen backlog is limited to 100 connections Aug 24 19:29:20.165041 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: your mercy for graceful operations on workers is 90 seconds Aug 24 19:29:20.165469 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 19:29:20.165469 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: *** Operational MODE: preforking *** Aug 24 19:29:20.165702 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: *** uWSGI is running in multiple interpreter mode *** Aug 24 19:29:20.165702 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: spawned uWSGI master process (pid: 108886) Aug 24 19:29:20.168656 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: spawned uWSGI worker 1 (pid: 108907, cores: 1) Aug 24 19:29:20.168656 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: spawned uWSGI worker 2 (pid: 108908, cores: 1) Aug 24 19:29:20.168656 dv-cinder-798198-3-iscsi devstack@n-api.service[108886]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 19:29:20.165902 dv-cinder-798198-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 19:29:21.974659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 19:29:21.974659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: from cryptography.utils import int_from_bytes Aug 24 19:29:21.975727 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 19:29:21.975727 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: from cryptography.utils import int_from_bytes Aug 24 19:29:22.003619 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 19:29:22.003619 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: from cryptography.utils import int_from_bytes Aug 24 19:29:22.004473 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 19:29:22.004473 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: from cryptography.utils import int_from_bytes Aug 24 19:29:24.532611 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 19:29:24.533167 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 19:29:24.533438 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 19:29:24.533729 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 19:29:24.533988 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 19:29:24.534413 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.534747 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.535072 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.535417 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.535751 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.536067 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.536507 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.536837 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.537169 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.537435 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.537757 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.538085 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-798198-3-iscsi {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.538413 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.539252 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.539568 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.539892 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.540202 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.540552 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.540861 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.541362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.542934 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.543267 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.543596 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.543950 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.544295 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.544620 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.544948 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.545275 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.545597 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.545914 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.546309 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-798198-3-iscsi {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.546659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.546988 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.547310 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.547733 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.548046 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.548384 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.548715 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.549045 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.549359 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.549706 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.550015 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.550362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.550692 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.551001 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.551317 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.551629 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.551958 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.552291 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.552629 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.552849 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.553162 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.553494 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.553814 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.554144 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.554934 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.555198 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.555576 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.555848 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.556157 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.556498 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.556811 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.557379 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.557689 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.558002 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.558313 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.558622 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.558946 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.559269 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.559597 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.559910 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.560300 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.560712 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.560972 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.561293 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.561638 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.561953 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.562272 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.562595 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.562923 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.563239 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.563554 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.563866 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.564191 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.564551 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.564866 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.565123 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.565435 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.565746 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.566073 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.566382 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.566694 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.567008 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.567316 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.567633 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.567946 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.568258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.568523 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 19:29:24.569024 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.569170 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 19:29:24.569405 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.569552 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 19:29:24.569695 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.569862 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 19:29:24.570034 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.570189 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 19:29:24.570374 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.570518 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.570659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.570822 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.570973 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.571160 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.571341 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.571490 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.571648 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.571807 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.571965 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.572119 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.572947 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.573129 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.573274 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.573424 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.573582 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.573732 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.573874 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.574025 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.574178 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.574325 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.574466 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.574621 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-798198-3-iscsi {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.574772 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.574914 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.575054 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.575195 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.575336 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.575496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.575766 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.575922 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.576073 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.576435 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.576594 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.576744 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.576979 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.577206 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.577373 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.577373 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.577662 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.577983 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.578144 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.578287 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.578436 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.578578 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.578768 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.578941 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.579092 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.579235 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.579376 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.579523 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.579686 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.579837 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.579979 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.580121 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.580283 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.580443 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.580595 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.580746 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.580909 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.581058 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.581205 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-798198-3-iscsi {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.581358 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.581508 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.581650 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.581791 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.581942 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.582107 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.582258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.582258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.583291 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.583450 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.583606 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.583606 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.583883 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.584026 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.584174 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.584350 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.584500 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.584654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.584813 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.584956 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.585104 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.585246 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.585469 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.585665 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.585958 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.586107 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.586258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.586418 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.586718 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.586880 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.587023 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.587164 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.587314 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.587464 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.587606 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.587773 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.587944 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.588210 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.588434 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.588590 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.588744 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.588898 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.589047 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.589189 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.589340 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.589537 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.589698 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.589866 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.590026 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.590177 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.590177 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.590917 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.591095 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.591247 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.591397 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.591548 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.591699 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.591858 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.592001 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.592163 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.592358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.592507 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.592648 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.593554 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.593713 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.593864 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.594014 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.594156 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.594297 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.594477 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.594704 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.594856 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.595024 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.595175 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.595328 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.595470 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.595612 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.595753 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.595946 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.596342 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.596513 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.596665 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.596980 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.597138 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.597294 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.597443 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.597674 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.597852 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.598006 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.598172 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.598442 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.598596 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.598748 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.598891 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.599039 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.599189 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.599338 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.599508 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.599652 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.599803 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.599952 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.600093 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.600234 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.600426 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.600632 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.600777 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.600917 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.601583 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.601770 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.601770 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.602142 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.602295 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.602447 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.602605 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.602753 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.602909 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.603790 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.603944 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.604092 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.604234 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.604444 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.604598 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.604740 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.604900 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.605042 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.605190 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.605347 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.605491 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.605633 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.605774 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.605922 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.606071 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.606249 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.606504 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.606659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.606821 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.606990 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.607280 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.607437 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.607582 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.607582 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.607870 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.608022 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.608177 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.608366 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.608684 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.608844 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.608994 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.609150 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.609292 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.609433 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.609588 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.609732 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.609881 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.610032 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.610182 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.610457 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.610605 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.610756 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.610906 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.611066 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.611229 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.611372 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.611520 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.615129 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.615314 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.615477 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.615634 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.615783 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.615938 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.616088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.616258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.616474 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.616474 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.617790 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.617944 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.618090 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.618243 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.618399 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.618552 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.618829 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.618993 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.619148 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.619299 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.619452 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.619596 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.619745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.619915 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.620069 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.620213 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.620541 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.620701 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.620903 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.621061 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.621212 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.621362 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.621362 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.621638 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.621780 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.621944 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.622096 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.622246 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.622425 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.622579 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.622722 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.622878 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.623033 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 19:29:24.623177 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.623320 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.623462 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.623611 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.623763 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.623933 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.623933 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.624239 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.625204 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.625370 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.625514 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.625656 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.625808 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.625950 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.626099 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.626254 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.626423 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.626568 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.626742 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.627042 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.627191 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.627424 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.627579 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.627723 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.628026 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.628185 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.628350 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.628515 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.628667 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.628830 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.629114 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.629262 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.629426 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.629426 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.629701 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.629852 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.629994 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.630143 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.630294 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.630436 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.630579 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.630721 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.630870 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.631024 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.631181 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.631330 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.631473 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.631615 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.631765 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.631765 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.632044 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.632187 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.632411 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.632558 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.632713 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.632863 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.633031 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.633031 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.633310 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.633310 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.633673 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.633848 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.633995 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.634144 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.634286 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.634438 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.635317 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.635482 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.635645 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.635802 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.635952 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.636094 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.636236 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.636483 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.636635 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.636635 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.636928 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.637201 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.637357 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.637520 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.637677 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.637839 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.638032 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.638334 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.638505 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.638663 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.638820 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.638971 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.639136 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.639136 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.639555 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.639713 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.639870 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.640020 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.640188 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.640361 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.640524 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.640683 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.640841 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.640990 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.641147 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.641297 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.641459 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.641615 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.641776 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.641926 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.642085 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.642258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.642407 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.642563 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.642720 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.642868 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.643016 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.643016 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.643313 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.643313 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.643599 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.643748 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.643895 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.643895 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.644204 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.644404 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.644564 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.644732 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.645580 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.645756 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.645906 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.646054 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.646203 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.646361 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.646523 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.646681 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.646856 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.647005 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.647175 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.647507 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.647690 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.647842 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.648035 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.648193 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.648547 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.648702 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.648862 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.649019 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.649169 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.649338 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.649618 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.649772 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.649934 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.650099 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.650247 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.650395 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.650544 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.650706 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.650856 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.651012 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.651160 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.651314 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.651483 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.651647 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.651804 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.651962 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.652119 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.652345 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.652513 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.652678 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.652828 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.652983 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.653144 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.653301 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.653458 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.653627 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.653785 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.653933 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.654088 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.654237 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.654237 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.654541 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.654700 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.654799 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.654882 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.654995 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.655108 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.655575 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.655682 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.655777 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.655864 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.655949 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.656043 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.656129 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.656223 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.656325 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.656426 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.656514 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.656612 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.656699 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.656783 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.656875 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.656960 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.657057 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.657143 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.657227 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.657317 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.657401 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.657512 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.657679 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.657767 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.657859 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.657944 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.658028 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.658112 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.658206 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.658300 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.658385 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.658468 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.658576 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.658663 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.658756 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.658843 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.658928 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.659021 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.659119 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.659205 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.659288 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.659380 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.659465 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.659564 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.659678 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.659764 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.659868 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.659959 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.660043 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.660140 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.660233 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.660350 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.660489 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.660658 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.660804 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.660943 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.661201 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.661295 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.661380 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.661543 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.661655 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.661755 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.661841 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.661932 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.662024 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.662109 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.662201 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.662286 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.662377 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.662477 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.662563 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.662690 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.662690 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.662690 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.662690 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.663170 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.663257 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.663257 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.663430 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.664061 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.664197 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.664375 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.664477 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.664568 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.664648 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.664729 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.664851 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.664960 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.665037 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.665118 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.665192 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.665271 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.665362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.665437 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.665895 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.666034 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.666167 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.666302 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.666431 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.666564 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.666661 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.666757 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.666853 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.666946 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667033 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667118 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667211 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667304 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667389 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667475 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667568 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.667679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668336 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668336 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668336 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668336 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668650 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668733 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668814 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.668894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.669383 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.669383 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.669519 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.669598 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.669598 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.669799 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.669889 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.669976 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.670056 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.670128 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.670206 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.670206 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.670544 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.670707 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.670927 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.671065 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.671304 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.671449 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.671628 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.671924 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.672233 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.672483 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.672629 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.672859 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.673007 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.673229 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.673405 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.673556 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.673868 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.674003 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.674207 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.674381 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.674542 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.674844 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.674981 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.675156 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.675506 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.676002 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.676002 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.676308 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.676446 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.676446 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.676732 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.676965 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.677104 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.677308 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.677514 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.677701 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.677920 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.678066 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.678222 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.678537 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.678681 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.678834 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.679145 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.679812 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.680038 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.680178 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.680353 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.680632 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.680767 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.680969 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.681284 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.681515 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.681672 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.682142 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.682285 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.682456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.682739 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.682877 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.683106 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.683260 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.683456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.683701 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.683854 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.684128 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.684340 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.684495 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.684679 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.684827 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.685087 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.685233 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.685399 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.685663 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.685823 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.686324 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.686595 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.686757 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.686757 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.687025 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.687163 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.687319 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.687511 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.687647 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.687826 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.688140 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.688321 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.688470 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.688778 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.688914 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.689088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.689368 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.689555 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.689703 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.689881 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.690027 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.690300 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.690445 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.690632 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.690864 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.691002 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.691362 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.691557 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.691711 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.691863 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.692078 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.692222 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.692519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.692673 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.692824 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.693062 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.693207 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.693428 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.693573 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.693744 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.694033 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.694179 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.694377 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.694553 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.694692 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.695022 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.695169 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.695341 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.695533 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.695686 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.695948 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.696107 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.696611 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.696862 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.697006 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.697006 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.697279 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.697519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.697677 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.697816 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.698059 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.698206 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.698421 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.698726 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.698865 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.699032 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.699262 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.699398 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.699637 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.699784 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.699948 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.700224 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.700450 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.700600 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.700749 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.700913 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.701225 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.701370 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.701666 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.701822 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.701975 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.702152 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.702290 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.702467 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.702687 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.702832 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.703136 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.703281 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.703457 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.703652 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.703798 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.704088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.704240 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.704465 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.704652 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.704804 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.705057 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.705194 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.705380 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.705619 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.705766 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.706002 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.706139 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.706311 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.706713 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.706892 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.707128 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.707269 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.707419 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.707572 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.707855 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.708156 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.708361 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.708547 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.708823 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.708976 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.709139 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.709429 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.709566 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.709755 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.709937 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.710105 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.710389 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.710528 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.710731 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.710999 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.711169 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.711447 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.711624 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.711769 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.711940 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.712197 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.712372 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.712606 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.712752 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.712922 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.713116 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.713255 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.713555 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.713704 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.713855 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.714072 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.714231 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.715054 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.715196 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.715334 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.715509 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.715672 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.715819 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.715961 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.715961 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.716231 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.716531 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.716531 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.717383 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.717524 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.717664 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.717813 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.717813 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.718091 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.718240 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.718240 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.718497 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.718657 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.718816 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.719056 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.719193 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.719374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.719660 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.719798 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.719993 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.720192 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.720428 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.720654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.720853 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.721017 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.721287 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.721447 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.721694 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.721841 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.721979 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.722333 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.722509 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.722655 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.722804 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.722941 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.723204 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.723357 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.723561 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.723847 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.723984 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.724301 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.724471 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.724623 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.724819 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.724957 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.725249 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.725448 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.725608 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.725899 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.726579 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.727235 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.727407 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.727650 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.727650 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.727943 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.728102 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.728102 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.728631 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.728769 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.729150 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.729298 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.729436 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.729586 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.729736 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.729736 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.730017 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.730154 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.730291 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.730437 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.730958 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.731118 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.731268 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.731406 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.731513 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.731609 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.731713 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.731943 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.732048 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.732260 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.732403 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.732626 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.732741 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.733009 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.733277 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.733406 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.733513 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.733619 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.733710 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.733906 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.734060 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.734211 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.734378 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.734529 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.734703 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.734845 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.735039 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.735161 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.735382 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.735494 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.735703 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.735798 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.736021 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.736116 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.736365 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.736479 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.736685 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.736787 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.737002 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.737111 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.737355 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.737458 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.737688 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.737778 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.738000 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.738107 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.738332 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.738503 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.738654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.738802 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.738947 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.739090 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.739250 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.739396 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.739539 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.739684 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.739864 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.740044 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.740190 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.740426 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.740575 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.740720 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.740863 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.741018 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.741170 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.741325 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.741469 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.741613 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.742351 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.742705 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.742974 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.743133 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.743279 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.743432 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.743584 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.743738 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.743892 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.744044 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.744188 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.744362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.744522 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.744668 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.744820 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.745115 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.745242 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.745342 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.745444 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.745535 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.745630 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.745718 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.745813 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.745993 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.746107 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.746306 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.746402 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.746615 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.746710 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.746948 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.747046 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.747259 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.747354 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.747580 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.747682 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.747892 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.747990 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.748198 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.748375 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.748540 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.748735 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.748905 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.749056 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.749212 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.749356 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.749503 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.749647 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.749847 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.750016 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.750167 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.750321 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.750467 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.750620 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.750778 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.750930 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.751075 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.751219 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.751371 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.751524 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.751677 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.751821 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.751966 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.752110 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.752286 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.752453 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.752624 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.752867 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.753132 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.753294 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.753441 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.753595 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.753740 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.753891 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.754040 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.754184 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.754337 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.754493 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.754639 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.754795 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.754940 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.755084 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.755237 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.755383 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.755525 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.755677 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.755822 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.755966 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.756120 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.756320 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.756488 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.756641 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.756796 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.756941 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.757098 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.757311 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.757479 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.757924 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.758157 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.758306 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.758461 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.758607 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.758753 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.758898 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.759049 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.759049 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.759362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.759507 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.759653 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.759805 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.759951 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.760109 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.760254 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.760451 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.760595 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.760739 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.760914 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.761086 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.761253 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.761620 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.761785 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.761939 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.762101 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.762301 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.762460 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.762612 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.762767 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.763029 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.763333 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.763486 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.763639 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.763786 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.763931 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.764088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.764234 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.764437 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.764584 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.764727 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.764879 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.765034 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.765185 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.765350 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.765503 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.765649 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.765793 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.765962 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.766107 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.766258 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.766410 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.766562 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.766719 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.766871 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.767036 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.767201 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.767362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.767555 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.768103 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.768411 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.768566 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.768719 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.768871 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.769030 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.769176 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.769329 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.769474 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.769474 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.769762 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.769921 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.770067 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.770224 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.770369 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.770513 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.770665 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.770823 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.770970 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.771115 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.771259 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.771403 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.771566 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.771566 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.771849 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.771994 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.772148 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.772322 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.772484 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.772671 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.772816 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.773012 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.773238 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.773497 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.773497 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.773813 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.773965 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.774118 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.774264 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.774415 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.774415 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.774703 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.774848 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.774992 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.775135 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.775365 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.775520 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.775730 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.775876 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.776027 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.776173 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.776501 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.776663 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.776808 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.776953 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.777104 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.777249 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.777417 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.777564 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.777708 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.777871 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.778261 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.778499 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.778666 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.778820 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.778966 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.778966 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.779258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.779415 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.779562 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.779713 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.779867 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.780029 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.780175 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.780349 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.780509 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.780663 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.780815 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.781075 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.781226 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.781385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.781537 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.781684 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.781830 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.781987 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.782156 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.782309 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.782455 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.782455 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.782455 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.782455 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.783066 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.783238 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.783481 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.783730 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.783888 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.784033 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.784191 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.784432 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.784593 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.784740 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.784884 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.785027 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.785185 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.785330 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.785475 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.785620 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.785765 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.785909 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.786062 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.786062 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.786062 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.786558 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.786701 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.786861 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.787012 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.787165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.787313 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.787472 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.787624 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.787778 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.787931 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.788093 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.788380 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.789137 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.789292 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.789447 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.789646 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.789803 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.789949 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.790102 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.790246 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.790246 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.790538 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.790691 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.790835 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.791000 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.791161 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.791308 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.791459 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.791611 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.791755 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.791899 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.792052 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.792309 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.792474 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.792629 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.792782 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.792930 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.793095 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.793249 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.793394 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.793394 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.793874 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.794034 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.794195 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.794341 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.794493 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.794639 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.794639 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.794922 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.795078 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.795224 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.795376 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.795527 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.795671 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.795828 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.795973 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.796116 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.796277 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.796442 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.796587 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.796741 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.796885 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.797040 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.797184 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.797336 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.797574 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.797727 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.797872 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.798016 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.798160 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.798328 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.798564 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.798717 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.798870 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.799023 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.799261 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.799414 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.799570 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.799726 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.799878 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.800027 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.800171 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.800441 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.800604 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.800751 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.800896 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.801041 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.801203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.801362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.801508 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.801653 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.801806 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.801951 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.802094 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.802253 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.802397 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.802550 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.802702 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.802925 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.803083 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.803242 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.803387 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.803539 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.803771 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.804029 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.804248 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.804947 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.805096 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.805248 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.805400 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.805546 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.805700 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.805865 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.806012 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.806165 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.806317 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.806462 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.806615 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.806768 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.807183 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.807330 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.807485 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.807639 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.807792 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.807948 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.808101 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.808247 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.808439 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.808721 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.808883 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.809029 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.809273 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.809491 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.809641 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.809795 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.809949 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.810094 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.810258 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.810412 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.810571 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.810716 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.810861 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.811135 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.811291 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.811435 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.811593 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.811740 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.811892 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.812038 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.812193 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.812370 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.812529 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.812675 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.812820 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.812964 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.813117 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.813261 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.813434 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.813724 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.813927 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.814076 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.814241 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.814571 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.814733 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.814932 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.815082 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.815228 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.815382 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.815544 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.815696 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.815847 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.815998 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.816149 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.816345 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.816527 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.816680 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.816839 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.816997 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.817149 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.817322 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.817476 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.817626 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.817776 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.817926 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.818083 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.818248 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.818401 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.818562 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.818827 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.818985 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.819136 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.819298 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.819475 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.819637 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.819813 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.819971 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.820132 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.820312 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.820472 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.820646 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.820646 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108908) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 19:29:24.820987 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.820987 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.820987 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.820987 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.820987 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.820987 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.821920 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.821920 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.821920 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.822375 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.822375 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.822737 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.823017 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.823350 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 19:29:24.823597 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108907) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 19:29:24.934283 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_db.sqlalchemy.engines [None req-db4051b3-e0c9-421b-be21-ca3f43ed94f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:29:24.940176 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_db.sqlalchemy.engines [None req-3a92aaec-77c9-4943-a7f0-e3aebb4a87e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:29:25.013465 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.context [None req-db4051b3-e0c9-421b-be21-ca3f43ed94f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9aa87762-c658-4c0f-874d-57bbc1863216(cell1) {{(pid=108908) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 19:29:25.017881 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-db4051b3-e0c9-421b-be21-ca3f43ed94f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:29:25.018302 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.context [None req-3a92aaec-77c9-4943-a7f0-e3aebb4a87e8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9aa87762-c658-4c0f-874d-57bbc1863216(cell1) {{(pid=108907) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 19:29:25.019483 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-db4051b3-e0c9-421b-be21-ca3f43ed94f9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:29:25.020304 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-db4051b3-e0c9-421b-be21-ca3f43ed94f9 None None] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:29:25.022540 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3a92aaec-77c9-4943-a7f0-e3aebb4a87e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:29:25.024501 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-db4051b3-e0c9-421b-be21-ca3f43ed94f9 None None] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:29:25.024794 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3a92aaec-77c9-4943-a7f0-e3aebb4a87e8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:29:25.025594 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3a92aaec-77c9-4943-a7f0-e3aebb4a87e8 None None] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:29:25.029380 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3a92aaec-77c9-4943-a7f0-e3aebb4a87e8 None None] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:29:25.035153 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_db.sqlalchemy.engines [None req-db4051b3-e0c9-421b-be21-ca3f43ed94f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:29:25.037470 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_db.sqlalchemy.engines [None req-db4051b3-e0c9-421b-be21-ca3f43ed94f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:29:25.041147 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_db.sqlalchemy.engines [None req-3a92aaec-77c9-4943-a7f0-e3aebb4a87e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:29:25.043188 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_db.sqlalchemy.engines [None req-3a92aaec-77c9-4943-a7f0-e3aebb4a87e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:29:25.306391 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_db.sqlalchemy.engines [None req-3a92aaec-77c9-4943-a7f0-e3aebb4a87e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108907) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:29:25.314658 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_db.sqlalchemy.engines [None req-db4051b3-e0c9-421b-be21-ca3f43ed94f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108908) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 19:29:25.637985 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: WARNING keystonemiddleware.auth_token [None req-db4051b3-e0c9-421b-be21-ca3f43ed94f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 19:29:25.638609 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: WARNING keystonemiddleware.auth_token [None req-3a92aaec-77c9-4943-a7f0-e3aebb4a87e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 19:29:25.644658 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: WARNING keystonemiddleware.auth_token [None req-db4051b3-e0c9-421b-be21-ca3f43ed94f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 19:29:25.644836 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: WARNING keystonemiddleware.auth_token [None req-3a92aaec-77c9-4943-a7f0-e3aebb4a87e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 19:29:25.995721 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: WARNING keystonemiddleware.auth_token [None req-db4051b3-e0c9-421b-be21-ca3f43ed94f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 19:29:25.996068 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: WARNING keystonemiddleware.auth_token [None req-3a92aaec-77c9-4943-a7f0-e3aebb4a87e8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 19:29:26.001382 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: WARNING keystonemiddleware.auth_token [None req-3a92aaec-77c9-4943-a7f0-e3aebb4a87e8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 19:29:26.001541 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: WARNING keystonemiddleware.auth_token [None req-db4051b3-e0c9-421b-be21-ca3f43ed94f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 19:29:26.006812 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555dac7d09c0 pid: 108907 (default app) Aug 24 19:29:26.006996 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555dac7d09c0 pid: 108908 (default app) Aug 24 19:30:01.010550 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-98315a84-ea75-4cbc-9943-4ed3d668234f tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] Action: 'create', calling method: .version_select at 0x7f8dfd36cdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-579615101", "metadata": {"Type": "work"}}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:01.156618 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9797b01e-8de4-4a03-8a44-ff8e5af921d0 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Action: 'create', calling method: .version_select at 0x7f8dfd36ddc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-762916227"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:02.801477 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-98315a84-ea75-4cbc-9943-4ed3d668234f tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.163381 Aug 24 19:30:02.804352 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Aug 24 19:29:59 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 3168 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 19:30:02.816685 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b02052a7-0dde-40f5-a31d-af9124c1c3ef tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] Calling method '.version_select at 0x7f8dfd23c820>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:03.314067 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b02052a7-0dde-40f5-a31d-af9124c1c3ef tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0" status: 200 len: 352 microversion: 2.1 time: 0.501440 Aug 24 19:30:03.315663 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 2/2] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:02 2021] GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0 => generated 352 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:03.418094 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9797b01e-8de4-4a03-8a44-ff8e5af921d0 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.691227 Aug 24 19:30:03.418094 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1155 bytes} [Tue Aug 24 19:29:59 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3694 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 19:30:03.426003 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7cbe5725-f862-4ef7-a0fe-dca6d1d908cb tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8dfd23cdc0>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:03.512728 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7cbe5725-f862-4ef7-a0fe-dca6d1d908cb tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/fdbe6ce7-73c7-40af-8fad-3624f69cbaeb" status: 200 len: 344 microversion: 2.1 time: 0.089920 Aug 24 19:30:03.514799 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 3/4] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:03 2021] GET /compute/v2.1/os-volumes/fdbe6ce7-73c7-40af-8fad-3624f69cbaeb => generated 344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:04.083616 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1058548195", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "networks": [{"uuid": "2440e2cd-2741-4efe-b877-aa22667c4499"}]}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:04.167463 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-247188805", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "networks": [{"uuid": "6a1a130c-ef7c-4e9a-95ba-539471ebdef0"}]}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:04.226421 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.network.neutron [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] validate_networks() for [('2440e2cd-2741-4efe-b877-aa22667c4499', None, None, None, None, None)] {{(pid=108908) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:30:04.304925 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.network.neutron [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] validate_networks() for [('6a1a130c-ef7c-4e9a-95ba-539471ebdef0', None, None, None, None, None)] {{(pid=108907) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:30:05.913034 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Flavor limits 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:30:05.913602 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Image limits 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:30:05.913935 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Flavor pref 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:30:05.914869 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Image pref 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:30:05.914869 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:30:05.942219 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:05.942858 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:05.943816 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:05.944529 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:05.957037 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Flavor limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:30:05.958107 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Image limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:30:05.959105 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Flavor pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:30:05.962702 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Image pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:30:05.962702 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:30:05.990890 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:05.992005 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:05.993104 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:05.994689 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:05.998368 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Getting quotas for project 7a54174229cb4b11bc07726eece4a2af. Resources: {'cores', 'ram', 'instances'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:30:06.015742 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Getting quotas for user 3c437fd9d3774ba58eb9b4726b7667b5 and project 7a54174229cb4b11bc07726eece4a2af. Resources: {'cores', 'ram', 'instances'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:30:06.045809 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Going to run 1 instances... {{(pid=108907) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:30:06.051508 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:30:06.081621 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Getting quotas for project 2638f04be6a545859cf47a40a24cb9c4. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:30:06.112414 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Getting quotas for user 1afabbd8a15f4bfc8649de7be75a4bed and project 2638f04be6a545859cf47a40a24cb9c4. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:30:06.128486 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Going to run 1 instances... {{(pid=108908) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:30:06.133167 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:30:06.269867 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-fe52cd89-1e6e-4cd7-af2f-e85ec8f31c06 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.166499 Aug 24 19:30:06.270539 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 4/5] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:30:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 2168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:30:06.287362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7da4f3c6-2bbc-4711-84b4-159b25e3bc72 tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] Calling method '.version_select at 0x7f8dfc8db040>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:06.336005 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-65e15425-0f80-4466-a5b8-16909f08f94d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.337575 Aug 24 19:30:06.343190 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 2/6] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:30:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 2346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 19:30:06.348980 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ec4be6c0-4fe5-4a46-8fd7-11426017e7b8 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8dfc0d8160>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:06.445026 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7da4f3c6-2bbc-4711-84b4-159b25e3bc72 tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0" status: 200 len: 353 microversion: 2.1 time: 0.173249 Aug 24 19:30:06.459126 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 5/7] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:06 2021] GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0 => generated 353 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:06.464157 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b9b1c3a8-d1b4-4c5f-b330-c39b8469fa0c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:06.465107 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b9b1c3a8-d1b4-4c5f-b330-c39b8469fa0c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:06.490704 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ec4be6c0-4fe5-4a46-8fd7-11426017e7b8 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/fdbe6ce7-73c7-40af-8fad-3624f69cbaeb" status: 200 len: 345 microversion: 2.1 time: 0.146080 Aug 24 19:30:06.499224 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 3/8] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:06 2021] GET /compute/v2.1/os-volumes/fdbe6ce7-73c7-40af-8fad-3624f69cbaeb => generated 345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:06.506568 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2e195b1c-7392-43c6-b8eb-bd8023bb6cf8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:06.507467 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2e195b1c-7392-43c6-b8eb-bd8023bb6cf8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:06.885099 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b9b1c3a8-d1b4-4c5f-b330-c39b8469fa0c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:06.907170 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-2e195b1c-7392-43c6-b8eb-bd8023bb6cf8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:06.925642 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b9b1c3a8-d1b4-4c5f-b330-c39b8469fa0c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1217 microversion: 2.1 time: 0.465012 Aug 24 19:30:06.945134 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2e195b1c-7392-43c6-b8eb-bd8023bb6cf8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1215 microversion: 2.1 time: 0.443697 Aug 24 19:30:06.945735 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 4/9] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:06 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1215 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:06.948426 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 6/10] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:06 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1217 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:06.960638 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-938e1ff0-c0ea-4e94-87ec-30374fad90f1 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Action: 'create', calling method: .version_select at 0x7f8dfc8f0af0>, body: {"snapshot": {"volume_id": "fdbe6ce7-73c7-40af-8fad-3624f69cbaeb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-967454536"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:06.968970 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-769b7a7e-d58d-4c87-8812-2242d9974f7f tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] Calling method '.version_select at 0x7f8dfc0d8670>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:07.121572 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-769b7a7e-d58d-4c87-8812-2242d9974f7f tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0" status: 200 len: 353 microversion: 2.1 time: 0.173316 Aug 24 19:30:07.122733 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 5/11] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:06 2021] GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0 => generated 353 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:07.141604 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-cb4eeede-11ee-4a33-92fd-7830f3137ef9 tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] Calling method '.version_select at 0x7f8dfc107c10>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:07.501703 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-cb4eeede-11ee-4a33-92fd-7830f3137ef9 tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0" status: 202 len: 0 microversion: 2.1 time: 0.363387 Aug 24 19:30:07.501703 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 24 19:30:07 2021] DELETE /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0 => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:30:07.508873 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-19f009dc-bf12-4ea9-94ae-bec28cce5fe2 tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] Calling method '.version_select at 0x7f8dfc10b310>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:07.634575 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-19f009dc-bf12-4ea9-94ae-bec28cce5fe2 tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0" status: 200 len: 352 microversion: 2.1 time: 0.129844 Aug 24 19:30:07.635141 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:07 2021] GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0 => generated 352 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:30:07.900771 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-938e1ff0-c0ea-4e94-87ec-30374fad90f1 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.951178 Aug 24 19:30:07.913841 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 7/14] 10.222.0.59 () {60 vars in 1162 bytes} [Tue Aug 24 19:30:06 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:07.915523 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-308a0f97-2b2f-4f00-9f34-9c7f2c8b1591 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8dfc107f70>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:07.962117 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fc20c906-a622-4beb-8a80-6ebc3ab356da tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:07.966086 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fc20c906-a622-4beb-8a80-6ebc3ab356da tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:07.980380 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-308a0f97-2b2f-4f00-9f34-9c7f2c8b1591 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44" status: 200 len: 286 microversion: 2.1 time: 0.068358 Aug 24 19:30:07.984427 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 8/15] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 24 19:30:07 2021] GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44 => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:30:07.986499 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-7db3c85b-0e4d-4e31-8370-c6b3bf20e22d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:07.987351 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-7db3c85b-0e4d-4e31-8370-c6b3bf20e22d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:08.212834 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-7db3c85b-0e4d-4e31-8370-c6b3bf20e22d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:08.234479 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-7db3c85b-0e4d-4e31-8370-c6b3bf20e22d tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1215 microversion: 2.1 time: 0.248335 Aug 24 19:30:08.240521 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 9/16] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:07 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1215 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:08.256799 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-bf93a749-be31-4f82-b988-b21af65ad2f9 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8dfc10bca0>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:08.261313 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fc20c906-a622-4beb-8a80-6ebc3ab356da tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:08.277805 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-fc20c906-a622-4beb-8a80-6ebc3ab356da tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1217 microversion: 2.1 time: 0.331504 Aug 24 19:30:08.277805 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 8/17] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:07 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1217 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:08.368215 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-bf93a749-be31-4f82-b988-b21af65ad2f9 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.125138 Aug 24 19:30:08.369961 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 10/18] 10.222.0.59 () {58 vars in 1140 bytes} [Tue Aug 24 19:30:08 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:08.381242 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6b308ec6-e125-49e0-8142-ddebf8ae4d4f tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8dfc8f0c10>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:08.437353 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6b308ec6-e125-49e0-8142-ddebf8ae4d4f tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44" status: 200 len: 286 microversion: 2.1 time: 0.060938 Aug 24 19:30:08.437948 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 9/19] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 24 19:30:08 2021] GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:08.648769 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1eeac89c-b752-4047-830a-7b01971d7526 tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] Calling method '.version_select at 0x7f8dfc0d8e50>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:08.804104 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1eeac89c-b752-4047-830a-7b01971d7526 tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0" status: 200 len: 352 microversion: 2.1 time: 0.159575 Aug 24 19:30:08.804729 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 11/20] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:08 2021] GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0 => generated 352 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:09.258081 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ae966702-cf9f-4521-8ef5-fcfc6d0d2dfd tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:09.259986 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ae966702-cf9f-4521-8ef5-fcfc6d0d2dfd tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:09.271918 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ae966702-cf9f-4521-8ef5-fcfc6d0d2dfd tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:09.272727 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ae966702-cf9f-4521-8ef5-fcfc6d0d2dfd tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:09.277388 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ae966702-cf9f-4521-8ef5-fcfc6d0d2dfd tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:09.280617 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ae966702-cf9f-4521-8ef5-fcfc6d0d2dfd tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:09.441107 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-312f5b34-fc0c-4321-9e71-0cefafa50ecc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'create', calling method: .version_select at 0x7f8dfc90f700>, body: {"keypair": {"name": "tempest-keypair-914740205"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:09.510731 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-312f5b34-fc0c-4321-9e71-0cefafa50ecc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Getting quotas for project 06ad67d05efc48a180df2740ce5dedba. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:30:09.518871 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-312f5b34-fc0c-4321-9e71-0cefafa50ecc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Getting quotas for user 8ac543b87ad24d2f97a6101885753717 and project 06ad67d05efc48a180df2740ce5dedba. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:30:09.603797 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ae966702-cf9f-4521-8ef5-fcfc6d0d2dfd tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:09.628245 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ae966702-cf9f-4521-8ef5-fcfc6d0d2dfd tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1219 microversion: 2.1 time: 0.370700 Aug 24 19:30:09.629771 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 12/21] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:09 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1219 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:09.636032 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2cd01d03-8558-4a4f-bd13-249118d740b2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:09.645148 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2cd01d03-8558-4a4f-bd13-249118d740b2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:09.659877 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2cd01d03-8558-4a4f-bd13-249118d740b2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:09.662426 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2cd01d03-8558-4a4f-bd13-249118d740b2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:09.663457 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2cd01d03-8558-4a4f-bd13-249118d740b2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:09.669404 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2cd01d03-8558-4a4f-bd13-249118d740b2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:09.804519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-2cd01d03-8558-4a4f-bd13-249118d740b2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:09.820935 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2cd01d03-8558-4a4f-bd13-249118d740b2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1221 microversion: 2.1 time: 0.184802 Aug 24 19:30:09.822218 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 13/22] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:09 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1221 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:09.832192 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b77ae927-2841-4511-884e-6bd3c7aa77db tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8dfc030820>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:09.881252 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-312f5b34-fc0c-4321-9e71-0cefafa50ecc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Getting quotas for project 06ad67d05efc48a180df2740ce5dedba. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:30:09.885528 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b77ae927-2841-4511-884e-6bd3c7aa77db tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44" status: 200 len: 286 microversion: 2.1 time: 0.061696 Aug 24 19:30:09.887089 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 14/23] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 24 19:30:09 2021] GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:09.892374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-761453a1-9c24-4e4d-a5ad-1f30688cf7ea tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] Calling method '.version_select at 0x7f8dfc0460d0>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:09.892568 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-312f5b34-fc0c-4321-9e71-0cefafa50ecc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Getting quotas for user 8ac543b87ad24d2f97a6101885753717 and project 06ad67d05efc48a180df2740ce5dedba. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:30:09.920177 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-312f5b34-fc0c-4321-9e71-0cefafa50ecc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.672404 Aug 24 19:30:09.927219 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 10/24] 10.222.0.59 () {62 vars in 1199 bytes} [Tue Aug 24 19:30:09 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 674 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 24 19:30:09.978328 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-761453a1-9c24-4e4d-a5ad-1f30688cf7ea tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0" status: 200 len: 352 microversion: 2.1 time: 0.089823 Aug 24 19:30:09.979026 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 15/25] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:09 2021] GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0 => generated 352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:10.648052 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e6c1c7ec-c893-4e82-94bc-76ac4fee6d1e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:10.648771 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e6c1c7ec-c893-4e82-94bc-76ac4fee6d1e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:10.663720 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6c1c7ec-c893-4e82-94bc-76ac4fee6d1e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:10.664180 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6c1c7ec-c893-4e82-94bc-76ac4fee6d1e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:10.664986 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6c1c7ec-c893-4e82-94bc-76ac4fee6d1e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:10.679506 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6c1c7ec-c893-4e82-94bc-76ac4fee6d1e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:10.839829 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e134b880-68bd-43de-883d-929c02e1eabf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:10.841294 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e134b880-68bd-43de-883d-929c02e1eabf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:10.856601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e134b880-68bd-43de-883d-929c02e1eabf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:10.869561 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e134b880-68bd-43de-883d-929c02e1eabf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:10.872008 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e134b880-68bd-43de-883d-929c02e1eabf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:10.874773 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e134b880-68bd-43de-883d-929c02e1eabf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:11.049915 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e134b880-68bd-43de-883d-929c02e1eabf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:11.054815 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e134b880-68bd-43de-883d-929c02e1eabf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1221 microversion: 2.1 time: 0.219927 Aug 24 19:30:11.056231 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 16/26] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:10 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1221 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:11.080255 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-617135e0-705b-4fcd-8e66-27739bfec479 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8dfc0300d0>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:11.144613 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-617135e0-705b-4fcd-8e66-27739bfec479 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44" status: 200 len: 286 microversion: 2.1 time: 0.071736 Aug 24 19:30:11.144613 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 17/27] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 24 19:30:11 2021] GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:11.144613 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-db4dadb2-b7a9-4976-9fb7-df976d7cf808 tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] Calling method '.version_select at 0x7f8dfc072ca0>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:11.157441 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e6c1c7ec-c893-4e82-94bc-76ac4fee6d1e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:11.186088 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e6c1c7ec-c893-4e82-94bc-76ac4fee6d1e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1219 microversion: 2.1 time: 0.541930 Aug 24 19:30:11.193122 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 11/28] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:10 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1219 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:11.268967 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-db4dadb2-b7a9-4976-9fb7-df976d7cf808 tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0" status: 200 len: 352 microversion: 2.1 time: 0.136163 Aug 24 19:30:11.269926 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 18/29] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:11 2021] GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0 => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:12.074812 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b54fa6fd-06a8-4b37-8000-4358955ac933 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:12.075580 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b54fa6fd-06a8-4b37-8000-4358955ac933 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:12.083038 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b54fa6fd-06a8-4b37-8000-4358955ac933 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:12.083854 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b54fa6fd-06a8-4b37-8000-4358955ac933 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:12.084776 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b54fa6fd-06a8-4b37-8000-4358955ac933 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:12.085518 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b54fa6fd-06a8-4b37-8000-4358955ac933 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:12.161246 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2e89a196-efc9-4978-886f-ad088983488b tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8dfc046670>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:12.228827 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2e89a196-efc9-4978-886f-ad088983488b tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44" status: 200 len: 286 microversion: 2.1 time: 0.080483 Aug 24 19:30:12.230009 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 19/30] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 24 19:30:12 2021] GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:12.235001 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-27a3718f-7d98-4405-ac40-87e64d565804 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:12.236488 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-27a3718f-7d98-4405-ac40-87e64d565804 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:12.259372 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-27a3718f-7d98-4405-ac40-87e64d565804 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:12.259907 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-27a3718f-7d98-4405-ac40-87e64d565804 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:12.261284 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-27a3718f-7d98-4405-ac40-87e64d565804 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:12.261726 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-27a3718f-7d98-4405-ac40-87e64d565804 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:12.399898 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b54fa6fd-06a8-4b37-8000-4358955ac933 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:12.410557 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b54fa6fd-06a8-4b37-8000-4358955ac933 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1221 microversion: 2.1 time: 0.341123 Aug 24 19:30:12.412844 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 12/31] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:12 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1221 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:12.420499 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d57d232f-7825-4a74-a68b-ef55f1a2620c tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] Calling method '.version_select at 0x7f8dfc052040>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:12.603034 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d57d232f-7825-4a74-a68b-ef55f1a2620c tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0" status: 200 len: 352 microversion: 2.1 time: 0.188625 Aug 24 19:30:12.605030 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 13/32] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:12 2021] GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0 => generated 352 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:12.666212 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-27a3718f-7d98-4405-ac40-87e64d565804 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:12.680635 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-27a3718f-7d98-4405-ac40-87e64d565804 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1219 microversion: 2.1 time: 0.448069 Aug 24 19:30:12.697070 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 20/33] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:12 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1219 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:13.242820 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-187ef67e-64fc-47ad-ab52-dc5eaa750dc0 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8df77e33a0>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:13.291352 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-187ef67e-64fc-47ad-ab52-dc5eaa750dc0 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44" status: 200 len: 287 microversion: 2.1 time: 0.053532 Aug 24 19:30:13.300144 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 14/34] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 24 19:30:13 2021] GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44 => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:13.304070 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a3939186-d7a0-496f-a79f-2efe28444060 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8dfc08d550>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:13.444123 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d529e816-26c9-47e7-8244-9c3b45bf7e24 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:13.448919 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d529e816-26c9-47e7-8244-9c3b45bf7e24 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:13.468916 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d529e816-26c9-47e7-8244-9c3b45bf7e24 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:13.476985 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d529e816-26c9-47e7-8244-9c3b45bf7e24 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:13.483358 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d529e816-26c9-47e7-8244-9c3b45bf7e24 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:13.483358 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d529e816-26c9-47e7-8244-9c3b45bf7e24 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:13.523016 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a3939186-d7a0-496f-a79f-2efe28444060 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44" status: 202 len: 0 microversion: 2.1 time: 0.222892 Aug 24 19:30:13.524059 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 21/35] 10.222.0.59 () {58 vars in 1254 bytes} [Tue Aug 24 19:30:13 2021] DELETE /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:30:13.531704 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8235a388-6bfb-4e14-8923-f84b79169e8a tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8dfc08d310>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:13.598024 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8235a388-6bfb-4e14-8923-f84b79169e8a tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44" status: 200 len: 286 microversion: 2.1 time: 0.069725 Aug 24 19:30:13.602074 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 22/36] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 24 19:30:13 2021] GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:13.615235 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6538b010-3c2b-4ab9-a4b7-7fadbe75d8a6 tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] Calling method '.version_select at 0x7f8dfc046310>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:13.674228 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-6538b010-3c2b-4ab9-a4b7-7fadbe75d8a6 tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] HTTP exception thrown: Volume ca07d9f2-8b00-442a-b58e-2f7dcf269ea0 could not be found. Aug 24 19:30:13.675073 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6538b010-3c2b-4ab9-a4b7-7fadbe75d8a6 tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] Returning 404 to user: Volume ca07d9f2-8b00-442a-b58e-2f7dcf269ea0 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:30:13.676081 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6538b010-3c2b-4ab9-a4b7-7fadbe75d8a6 tempest-VolumesGetTestJSON-268727473 tempest-VolumesGetTestJSON-268727473-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0" status: 404 len: 109 microversion: 2.1 time: 0.064604 Aug 24 19:30:13.677122 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 23/37] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:13 2021] GET /compute/v2.1/os-volumes/ca07d9f2-8b00-442a-b58e-2f7dcf269ea0 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:30:13.750166 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-d529e816-26c9-47e7-8244-9c3b45bf7e24 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:13.753861 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d529e816-26c9-47e7-8244-9c3b45bf7e24 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1221 microversion: 2.1 time: 0.326063 Aug 24 19:30:13.754450 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 15/38] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:13 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1221 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:13.773589 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-2ba3a872-64e4-427e-a1ac-1276ba24d0b3 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:13.785304 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-2ba3a872-64e4-427e-a1ac-1276ba24d0b3 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:13.785304 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2ba3a872-64e4-427e-a1ac-1276ba24d0b3 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:13.790367 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2ba3a872-64e4-427e-a1ac-1276ba24d0b3 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:13.791489 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2ba3a872-64e4-427e-a1ac-1276ba24d0b3 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:13.793248 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2ba3a872-64e4-427e-a1ac-1276ba24d0b3 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:13.799433 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-823617096", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e70092ee-01e0-4510-8c36-816b342ef97f"}]}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:13.976831 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2ba3a872-64e4-427e-a1ac-1276ba24d0b3 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:13.989505 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-2ba3a872-64e4-427e-a1ac-1276ba24d0b3 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1211 microversion: 2.1 time: 0.233092 Aug 24 19:30:13.993449 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 16/39] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:13 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1211 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:14.013057 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.network.neutron [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] validate_networks() for [('e70092ee-01e0-4510-8c36-816b342ef97f', None, None, None, None, None)] {{(pid=108908) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:30:14.092938 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-2e579767-3437-4768-b9f9-cf5494358352 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'create', calling method: .version_select at 0x7f8dfdbc21f0>, body: {"keypair": {"name": "tempest-keypair-1231874078"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:14.143847 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-2e579767-3437-4768-b9f9-cf5494358352 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Getting quotas for project 0bcba9a91f5e4855bdf5044613de0321. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:30:14.155070 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-2e579767-3437-4768-b9f9-cf5494358352 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Getting quotas for user b3a89d7e4c2040ab814a75c5463d9f2a and project 0bcba9a91f5e4855bdf5044613de0321. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:30:15.010037 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-2e579767-3437-4768-b9f9-cf5494358352 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Getting quotas for project 0bcba9a91f5e4855bdf5044613de0321. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:30:15.010037 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-2e579767-3437-4768-b9f9-cf5494358352 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Getting quotas for user b3a89d7e4c2040ab814a75c5463d9f2a and project 0bcba9a91f5e4855bdf5044613de0321. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:30:15.010037 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-2e579767-3437-4768-b9f9-cf5494358352 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.818926 Aug 24 19:30:15.010037 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 17/40] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Aug 24 19:30:13 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:15.010037 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4885562f-dbbb-4563-955f-c4ca101cb6cc tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8df77e3670>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:15.018703 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-4885562f-dbbb-4563-955f-c4ca101cb6cc tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] HTTP exception thrown: Snapshot 9e0167f6-ab25-41db-932c-21347993fb44 could not be found. Aug 24 19:30:15.018703 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4885562f-dbbb-4563-955f-c4ca101cb6cc tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Returning 404 to user: Snapshot 9e0167f6-ab25-41db-932c-21347993fb44 could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:30:15.018703 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4885562f-dbbb-4563-955f-c4ca101cb6cc tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44" status: 404 len: 111 microversion: 2.1 time: 0.049607 Aug 24 19:30:15.018703 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 18/41] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 24 19:30:14 2021] GET /compute/v2.1/os-snapshots/9e0167f6-ab25-41db-932c-21347993fb44 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:30:15.018703 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-3b86e7df-69e3-47e5-8d8a-76502c1151f4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:15.023644 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3b86e7df-69e3-47e5-8d8a-76502c1151f4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:15.023644 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3b86e7df-69e3-47e5-8d8a-76502c1151f4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:15.023644 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3b86e7df-69e3-47e5-8d8a-76502c1151f4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:15.023644 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3b86e7df-69e3-47e5-8d8a-76502c1151f4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:15.044747 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3b86e7df-69e3-47e5-8d8a-76502c1151f4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:15.173815 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3b86e7df-69e3-47e5-8d8a-76502c1151f4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:15.200727 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-3b86e7df-69e3-47e5-8d8a-76502c1151f4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1269 microversion: 2.1 time: 0.307874 Aug 24 19:30:15.200727 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 19/42] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:14 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1269 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:15.200727 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-22e1a7ce-4091-4d5d-87fb-d19e40963714 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8df77e3b80>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:15.533213 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-22e1a7ce-4091-4d5d-87fb-d19e40963714 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/fdbe6ce7-73c7-40af-8fad-3624f69cbaeb" status: 202 len: 0 microversion: 2.1 time: 0.342831 Aug 24 19:30:15.533924 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 20/43] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 24 19:30:15 2021] DELETE /compute/v2.1/os-volumes/fdbe6ce7-73c7-40af-8fad-3624f69cbaeb => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:30:15.542716 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1b31f9cc-7ac4-427c-a289-7e972b53bbd5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:15.564746 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1b31f9cc-7ac4-427c-a289-7e972b53bbd5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:15.565460 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1b31f9cc-7ac4-427c-a289-7e972b53bbd5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:15.566099 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1b31f9cc-7ac4-427c-a289-7e972b53bbd5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:15.567241 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1b31f9cc-7ac4-427c-a289-7e972b53bbd5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:15.567860 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1b31f9cc-7ac4-427c-a289-7e972b53bbd5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:15.942479 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Flavor limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:30:15.942952 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Image limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:30:15.943161 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1b31f9cc-7ac4-427c-a289-7e972b53bbd5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:15.943364 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Flavor pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:30:15.943778 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Image pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:30:15.946284 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:30:15.958031 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1b31f9cc-7ac4-427c-a289-7e972b53bbd5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1285 microversion: 2.1 time: 0.418481 Aug 24 19:30:15.958031 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 21/44] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:15 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1285 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:15.960095 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7e243a31-fc1e-4c87-b8df-758220ec697d tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8df77e3820>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:15.961987 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:15.962590 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:15.964146 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:15.966914 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:15.988542 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Getting quotas for project 12f52cbd047b400a8376723f14c37c65. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:30:15.993129 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Getting quotas for user 9fb0f69d69264e3394a61616951270bf and project 12f52cbd047b400a8376723f14c37c65. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:30:16.008908 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Going to run 1 instances... {{(pid=108908) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:30:16.011344 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:30:16.045594 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7e243a31-fc1e-4c87-b8df-758220ec697d tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/fdbe6ce7-73c7-40af-8fad-3624f69cbaeb" status: 200 len: 344 microversion: 2.1 time: 0.089152 Aug 24 19:30:16.050641 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 22/45] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:15 2021] GET /compute/v2.1/os-volumes/fdbe6ce7-73c7-40af-8fad-3624f69cbaeb => generated 344 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:16.211458 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fca43633-7b7a-478e-a20e-521910294ee6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:16.212072 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fca43633-7b7a-478e-a20e-521910294ee6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:16.218345 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fca43633-7b7a-478e-a20e-521910294ee6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:16.219199 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fca43633-7b7a-478e-a20e-521910294ee6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:16.220933 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fca43633-7b7a-478e-a20e-521910294ee6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:16.221568 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fca43633-7b7a-478e-a20e-521910294ee6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:16.248605 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-42e7efdb-d427-4e17-a508-6cd6bf46140a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.559004 Aug 24 19:30:16.249329 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:30:13 2021] POST /compute/v2.1/servers => generated 383 bytes in 2572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:30:16.261933 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a69b9868-16ee-458e-9e1e-69f5772214a7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:16.262601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a69b9868-16ee-458e-9e1e-69f5772214a7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:16.474032 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fca43633-7b7a-478e-a20e-521910294ee6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:16.481447 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-fca43633-7b7a-478e-a20e-521910294ee6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1287 microversion: 2.1 time: 0.273545 Aug 24 19:30:16.482111 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 23/47] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:16 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1287 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:16.491446 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a69b9868-16ee-458e-9e1e-69f5772214a7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:16.524592 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a69b9868-16ee-458e-9e1e-69f5772214a7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1221 microversion: 2.1 time: 0.261553 Aug 24 19:30:16.526529 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 25/48] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:16 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1221 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:16.823128 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1588979380", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e70092ee-01e0-4510-8c36-816b342ef97f"}]}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:16.959721 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.network.neutron [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] validate_networks() for [('e70092ee-01e0-4510-8c36-816b342ef97f', None, None, None, None, None)] {{(pid=108907) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:30:16.974551 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9dbf10d6-7c1c-438a-a907-4c51477c63f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:16.975163 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9dbf10d6-7c1c-438a-a907-4c51477c63f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:16.987142 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9dbf10d6-7c1c-438a-a907-4c51477c63f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:16.987806 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9dbf10d6-7c1c-438a-a907-4c51477c63f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:16.988709 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9dbf10d6-7c1c-438a-a907-4c51477c63f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:16.991434 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9dbf10d6-7c1c-438a-a907-4c51477c63f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:17.355346 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9dbf10d6-7c1c-438a-a907-4c51477c63f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:17.364819 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9dbf10d6-7c1c-438a-a907-4c51477c63f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1273 microversion: 2.1 time: 0.396990 Aug 24 19:30:17.366741 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 26/49] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:16 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1273 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:17.375008 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2aa877ac-9273-44f8-99a5-8434e8b2a84f tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8dfc08da60>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:17.411635 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-2aa877ac-9273-44f8-99a5-8434e8b2a84f tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] HTTP exception thrown: Volume fdbe6ce7-73c7-40af-8fad-3624f69cbaeb could not be found. Aug 24 19:30:17.413223 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2aa877ac-9273-44f8-99a5-8434e8b2a84f tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Returning 404 to user: Volume fdbe6ce7-73c7-40af-8fad-3624f69cbaeb could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:30:17.414060 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2aa877ac-9273-44f8-99a5-8434e8b2a84f tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/fdbe6ce7-73c7-40af-8fad-3624f69cbaeb" status: 404 len: 109 microversion: 2.1 time: 0.044307 Aug 24 19:30:17.415114 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 27/50] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:17 2021] GET /compute/v2.1/os-volumes/fdbe6ce7-73c7-40af-8fad-3624f69cbaeb => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:30:17.426107 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-34994f62-dbf5-4f29-ba89-24f2802b7f53 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8df7fcd4c0>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:17.497262 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-34994f62-dbf5-4f29-ba89-24f2802b7f53 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] HTTP exception thrown: Volume fdbe6ce7-73c7-40af-8fad-3624f69cbaeb could not be found. Aug 24 19:30:17.498191 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-34994f62-dbf5-4f29-ba89-24f2802b7f53 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Returning 404 to user: Volume fdbe6ce7-73c7-40af-8fad-3624f69cbaeb could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:30:17.499253 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-34994f62-dbf5-4f29-ba89-24f2802b7f53 tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/fdbe6ce7-73c7-40af-8fad-3624f69cbaeb" status: 404 len: 109 microversion: 2.1 time: 0.077870 Aug 24 19:30:17.500299 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 28/51] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 24 19:30:17 2021] DELETE /compute/v2.1/os-volumes/fdbe6ce7-73c7-40af-8fad-3624f69cbaeb => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 19:30:17.507186 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-43f5da6c-1ded-42a9-9349-b65cb593305b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:17.518133 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-43f5da6c-1ded-42a9-9349-b65cb593305b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:17.538415 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-43f5da6c-1ded-42a9-9349-b65cb593305b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:17.539094 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-43f5da6c-1ded-42a9-9349-b65cb593305b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:17.540031 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-43f5da6c-1ded-42a9-9349-b65cb593305b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:17.540560 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-43f5da6c-1ded-42a9-9349-b65cb593305b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:17.749045 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-43f5da6c-1ded-42a9-9349-b65cb593305b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:17.759388 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-43f5da6c-1ded-42a9-9349-b65cb593305b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1275 microversion: 2.1 time: 0.256940 Aug 24 19:30:17.766557 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 29/52] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:17 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1275 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:17.772051 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-64b41a76-4c41-495a-8e19-ad5003ba5e8a tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Calling method '.version_select at 0x7f8dfdbc24c0>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:17.852975 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-64b41a76-4c41-495a-8e19-ad5003ba5e8a tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] HTTP exception thrown: Volume fdbe6ce7-73c7-40af-8fad-3624f69cbaeb could not be found. Aug 24 19:30:17.854148 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-64b41a76-4c41-495a-8e19-ad5003ba5e8a tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] Returning 404 to user: Volume fdbe6ce7-73c7-40af-8fad-3624f69cbaeb could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:30:17.855388 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-64b41a76-4c41-495a-8e19-ad5003ba5e8a tempest-VolumesSnapshotsTestJSON-1817992963 tempest-VolumesSnapshotsTestJSON-1817992963-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/fdbe6ce7-73c7-40af-8fad-3624f69cbaeb" status: 404 len: 109 microversion: 2.1 time: 0.087060 Aug 24 19:30:17.856004 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 30/53] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:17 2021] GET /compute/v2.1/os-volumes/fdbe6ce7-73c7-40af-8fad-3624f69cbaeb => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:30:18.385101 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ded69a73-7a03-4670-8559-70da900068d1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:18.385817 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ded69a73-7a03-4670-8559-70da900068d1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:18.395101 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ded69a73-7a03-4670-8559-70da900068d1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:18.395654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ded69a73-7a03-4670-8559-70da900068d1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:18.396784 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ded69a73-7a03-4670-8559-70da900068d1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:18.397398 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ded69a73-7a03-4670-8559-70da900068d1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:18.627737 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ded69a73-7a03-4670-8559-70da900068d1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:18.641853 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ded69a73-7a03-4670-8559-70da900068d1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1273 microversion: 2.1 time: 0.259281 Aug 24 19:30:18.642973 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 31/54] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:18 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:18.655804 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-260045131", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a5ad5e3-9c10-4546-ad12-dff1390a5197"}], "security_groups": [{"name": "tempest-securitygroup--1774703295"}], "key_name": "tempest-keypair-914740205", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:19.465389 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.network.neutron [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] validate_networks() for [('0a5ad5e3-9c10-4546-ad12-dff1390a5197', None, None, None, None, None)] {{(pid=108908) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:30:19.621754 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Flavor limits 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:30:19.622938 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Image limits 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:30:19.624552 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Flavor pref 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:30:19.625106 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Image pref 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:30:19.626305 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:30:19.641431 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:19.644292 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:19.645504 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:19.647133 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:19.701725 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Getting quotas for project 12f52cbd047b400a8376723f14c37c65. Resources: {'cores', 'ram', 'instances'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:30:19.711437 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Getting quotas for user 9fb0f69d69264e3394a61616951270bf and project 12f52cbd047b400a8376723f14c37c65. Resources: {'cores', 'ram', 'instances'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:30:19.737038 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Going to run 1 instances... {{(pid=108907) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:30:19.747471 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:30:19.960826 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-3b1f9b1a-9e72-4446-88eb-aa387325f3f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.156820 Aug 24 19:30:19.966766 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 24/55] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:30:16 2021] POST /compute/v2.1/servers => generated 383 bytes in 3163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:30:19.973001 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e9a9c570-0085-4d18-a66f-c971c82d39fe tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:19.975051 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e9a9c570-0085-4d18-a66f-c971c82d39fe tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:19.999371 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e9a9c570-0085-4d18-a66f-c971c82d39fe tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:19.999835 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e9a9c570-0085-4d18-a66f-c971c82d39fe tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:20.001072 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e9a9c570-0085-4d18-a66f-c971c82d39fe tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:20.001519 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e9a9c570-0085-4d18-a66f-c971c82d39fe tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:21.921398 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e9a9c570-0085-4d18-a66f-c971c82d39fe tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:21.940037 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e9a9c570-0085-4d18-a66f-c971c82d39fe tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 1.969761 Aug 24 19:30:21.942221 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 25/56] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:19 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:21.967417 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-feb2e397-4e4b-4f1a-bcba-ee2584d655bf tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:21.981533 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-feb2e397-4e4b-4f1a-bcba-ee2584d655bf tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:21.997654 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-feb2e397-4e4b-4f1a-bcba-ee2584d655bf tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:22.006817 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-feb2e397-4e4b-4f1a-bcba-ee2584d655bf tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:22.006817 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-feb2e397-4e4b-4f1a-bcba-ee2584d655bf tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:22.006817 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-feb2e397-4e4b-4f1a-bcba-ee2584d655bf tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:22.109878 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Flavor limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:30:22.115211 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Image limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:30:22.116005 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Flavor pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:30:22.116781 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Image pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:30:22.117529 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:30:22.148125 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:22.148986 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:22.150155 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:22.150873 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:22.212556 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Getting quotas for project 06ad67d05efc48a180df2740ce5dedba. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:30:22.228827 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Getting quotas for user 8ac543b87ad24d2f97a6101885753717 and project 06ad67d05efc48a180df2740ce5dedba. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:30:22.271120 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Going to run 1 instances... {{(pid=108908) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:30:22.273898 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:30:22.551783 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-48da19aa-a062-4491-a31c-83bba002814a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.907452 Aug 24 19:30:22.555570 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 32/57] 10.222.0.59 () {62 vars in 1188 bytes} [Tue Aug 24 19:30:18 2021] POST /compute/v2.1/servers => generated 402 bytes in 3911 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 19:30:22.581575 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-425f2699-41f0-437e-a76f-3f1f05a7e966 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:22.582591 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-425f2699-41f0-437e-a76f-3f1f05a7e966 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:22.593578 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-425f2699-41f0-437e-a76f-3f1f05a7e966 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:22.594714 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-425f2699-41f0-437e-a76f-3f1f05a7e966 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:22.595568 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-425f2699-41f0-437e-a76f-3f1f05a7e966 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:22.596111 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-425f2699-41f0-437e-a76f-3f1f05a7e966 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:23.101163 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-425f2699-41f0-437e-a76f-3f1f05a7e966 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:23.110367 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-425f2699-41f0-437e-a76f-3f1f05a7e966 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1218 microversion: 2.1 time: 0.551056 Aug 24 19:30:23.116550 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 33/58] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:22 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1218 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:23.133797 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4ac386db-7b50-4de7-8cf6-ef8f45a9fa20 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:23.137125 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4ac386db-7b50-4de7-8cf6-ef8f45a9fa20 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:23.611930 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-feb2e397-4e4b-4f1a-bcba-ee2584d655bf tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:23.612583 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4ac386db-7b50-4de7-8cf6-ef8f45a9fa20 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:23.622789 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4ac386db-7b50-4de7-8cf6-ef8f45a9fa20 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:23.628091 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4ac386db-7b50-4de7-8cf6-ef8f45a9fa20 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:23.628343 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-feb2e397-4e4b-4f1a-bcba-ee2584d655bf tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 1.684560 Aug 24 19:30:23.630817 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4ac386db-7b50-4de7-8cf6-ef8f45a9fa20 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1280 microversion: 2.20 time: 0.511889 Aug 24 19:30:23.633036 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 34/59] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:23 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1280 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:23.640842 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 26/60] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:21 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:23.642376 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-938d2040-7155-49b2-a65d-116e42ca31cf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:23.644796 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-938d2040-7155-49b2-a65d-116e42ca31cf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:23.659047 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-938d2040-7155-49b2-a65d-116e42ca31cf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:23.664001 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-938d2040-7155-49b2-a65d-116e42ca31cf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:23.666326 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-938d2040-7155-49b2-a65d-116e42ca31cf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:23.668995 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-938d2040-7155-49b2-a65d-116e42ca31cf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:23.918708 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-490697729", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15cf5dcf-738d-44b5-831d-34d65a4aa388"}], "security_groups": [{"name": "tempest-securitygroup--768224586"}], "key_name": "tempest-keypair-1231874078", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:24.385195 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.network.neutron [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] validate_networks() for [('15cf5dcf-738d-44b5-831d-34d65a4aa388', None, None, None, None, None)] {{(pid=108907) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:30:24.813573 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-938d2040-7155-49b2-a65d-116e42ca31cf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:24.834186 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-938d2040-7155-49b2-a65d-116e42ca31cf tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 1.199218 Aug 24 19:30:24.836712 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 35/61] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:23 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:24.846700 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-001267ac-a0fb-4a68-8f49-249331ea8e7b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:24.853392 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-001267ac-a0fb-4a68-8f49-249331ea8e7b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:24.870197 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-001267ac-a0fb-4a68-8f49-249331ea8e7b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:24.870996 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-001267ac-a0fb-4a68-8f49-249331ea8e7b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:24.872633 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-001267ac-a0fb-4a68-8f49-249331ea8e7b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:24.873261 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-001267ac-a0fb-4a68-8f49-249331ea8e7b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:25.368474 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-001267ac-a0fb-4a68-8f49-249331ea8e7b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:25.385488 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-001267ac-a0fb-4a68-8f49-249331ea8e7b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1274 microversion: 2.1 time: 0.545898 Aug 24 19:30:25.386076 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 36/62] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:24 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1274 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:25.406764 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-16744ccf-c362-4c4b-a379-14fe47c7f7b9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:25.407468 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-16744ccf-c362-4c4b-a379-14fe47c7f7b9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:25.433087 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-16744ccf-c362-4c4b-a379-14fe47c7f7b9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:25.433563 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-16744ccf-c362-4c4b-a379-14fe47c7f7b9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:25.434690 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-16744ccf-c362-4c4b-a379-14fe47c7f7b9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:25.435124 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-16744ccf-c362-4c4b-a379-14fe47c7f7b9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:26.707131 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-16744ccf-c362-4c4b-a379-14fe47c7f7b9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:26.717391 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-16744ccf-c362-4c4b-a379-14fe47c7f7b9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 1.326152 Aug 24 19:30:26.721107 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 37/63] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:25 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:26.736481 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ca23c6ff-cc85-458d-8b1e-753de354107c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:26.743876 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ca23c6ff-cc85-458d-8b1e-753de354107c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:26.763525 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ca23c6ff-cc85-458d-8b1e-753de354107c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:26.765885 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ca23c6ff-cc85-458d-8b1e-753de354107c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:26.769088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ca23c6ff-cc85-458d-8b1e-753de354107c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:26.769798 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ca23c6ff-cc85-458d-8b1e-753de354107c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:26.921099 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ca23c6ff-cc85-458d-8b1e-753de354107c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:26.935391 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ca23c6ff-cc85-458d-8b1e-753de354107c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:26.939840 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ca23c6ff-cc85-458d-8b1e-753de354107c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:26.944101 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ca23c6ff-cc85-458d-8b1e-753de354107c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1332 microversion: 2.20 time: 0.217860 Aug 24 19:30:26.944101 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 38/64] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:26 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1332 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:26.947643 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e3ce2098-c5e1-41b2-baf2-aed646e6ae67 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:26.948515 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e3ce2098-c5e1-41b2-baf2-aed646e6ae67 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:26.955715 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3ce2098-c5e1-41b2-baf2-aed646e6ae67 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:26.956462 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3ce2098-c5e1-41b2-baf2-aed646e6ae67 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:26.957769 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3ce2098-c5e1-41b2-baf2-aed646e6ae67 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:26.958432 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3ce2098-c5e1-41b2-baf2-aed646e6ae67 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:27.888723 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Flavor limits 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:30:27.889805 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Image limits 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:30:27.890760 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Flavor pref 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:30:27.893190 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Image pref 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:30:27.894357 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:30:27.905731 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:27.906531 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:27.907699 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:27.908456 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:27.918018 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e3ce2098-c5e1-41b2-baf2-aed646e6ae67 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:27.955893 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e3ce2098-c5e1-41b2-baf2-aed646e6ae67 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 1.012128 Aug 24 19:30:27.956059 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Getting quotas for project 0bcba9a91f5e4855bdf5044613de0321. Resources: {'cores', 'ram', 'instances'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:30:27.963304 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 39/65] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:26 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:27.964654 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Getting quotas for user b3a89d7e4c2040ab814a75c5463d9f2a and project 0bcba9a91f5e4855bdf5044613de0321. Resources: {'cores', 'ram', 'instances'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:30:27.979631 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-fef0b41c-899a-4cfc-8e6e-2518f68ce991 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] Calling method '.version_select at 0x7f8df7f881f0>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:27.998411 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Going to run 1 instances... {{(pid=108907) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:30:28.003348 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:30:28.103187 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-fef0b41c-899a-4cfc-8e6e-2518f68ce991 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/3fa69b82-1004-477c-af8b-0d7ca0000c01" status: 200 len: 351 microversion: 2.1 time: 0.138344 Aug 24 19:30:28.103623 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 40/66] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:27 2021] GET /compute/v2.1/os-volumes/3fa69b82-1004-477c-af8b-0d7ca0000c01 => generated 351 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:28.202289 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1493f1d7-e9a7-4d20-a405-d4ef6718c045 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.291429 Aug 24 19:30:28.207720 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 27/67] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:30:23 2021] POST /compute/v2.1/servers => generated 401 bytes in 4293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 19:30:28.223782 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ec4368af-7733-4c0f-b47d-4b3c5b3cf239 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:28.228800 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ec4368af-7733-4c0f-b47d-4b3c5b3cf239 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:28.257246 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ec4368af-7733-4c0f-b47d-4b3c5b3cf239 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:28.257728 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ec4368af-7733-4c0f-b47d-4b3c5b3cf239 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:28.276745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ec4368af-7733-4c0f-b47d-4b3c5b3cf239 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:28.279546 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ec4368af-7733-4c0f-b47d-4b3c5b3cf239 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:28.287964 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-feed4c60-5a69-4ff3-914c-06efbe7adf9c req-fa61116f-08d7-49e9-8c81-e2eac3e4f73b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba289862-3027-492b-b4d1-d8539e4f3126", "tag": "f5cceb43-bd57-4a70-b5d7-600c3c4c3870"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:28.290601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:30:28.290601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:30:28.337954 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-feed4c60-5a69-4ff3-914c-06efbe7adf9c req-fa61116f-08d7-49e9-8c81-e2eac3e4f73b service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:28.337954 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-feed4c60-5a69-4ff3-914c-06efbe7adf9c req-fa61116f-08d7-49e9-8c81-e2eac3e4f73b service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:28.567036 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-feed4c60-5a69-4ff3-914c-06efbe7adf9c req-fa61116f-08d7-49e9-8c81-e2eac3e4f73b service nova] Creating event network-changed:f5cceb43-bd57-4a70-b5d7-600c3c4c3870 for instance ba289862-3027-492b-b4d1-d8539e4f3126 on hv-cinder-79819 Aug 24 19:30:28.567036 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-feed4c60-5a69-4ff3-914c-06efbe7adf9c req-fa61116f-08d7-49e9-8c81-e2eac3e4f73b service nova] Acquired lock "compute-rpcapi-router" {{(pid=108908) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 24 19:30:28.567036 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0a3f5c89-cf1a-4e30-9fea-4d2a1b911a93 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:28.567036 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0a3f5c89-cf1a-4e30-9fea-4d2a1b911a93 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:28.567036 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0a3f5c89-cf1a-4e30-9fea-4d2a1b911a93 None None] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:28.569769 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0a3f5c89-cf1a-4e30-9fea-4d2a1b911a93 None None] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:28.569769 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.compute.rpcapi [None req-0a3f5c89-cf1a-4e30-9fea-4d2a1b911a93 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 24 19:30:28.569769 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0a3f5c89-cf1a-4e30-9fea-4d2a1b911a93 None None] Releasing lock "compute-rpcapi-router" {{(pid=108908) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 24 19:30:28.569769 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0a3f5c89-cf1a-4e30-9fea-4d2a1b911a93 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.373368 Aug 24 19:30:28.569769 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 41/68] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:30:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:28.569769 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e2128c58-d42c-42a5-ac87-21eee9836214 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:28.576965 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e2128c58-d42c-42a5-ac87-21eee9836214 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:28.576965 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e2128c58-d42c-42a5-ac87-21eee9836214 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:28.576965 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e2128c58-d42c-42a5-ac87-21eee9836214 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:28.576965 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e2128c58-d42c-42a5-ac87-21eee9836214 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:28.578667 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e2128c58-d42c-42a5-ac87-21eee9836214 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:28.724651 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ec4368af-7733-4c0f-b47d-4b3c5b3cf239 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:28.749179 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ec4368af-7733-4c0f-b47d-4b3c5b3cf239 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1322 microversion: 2.1 time: 0.540231 Aug 24 19:30:28.761462 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 28/69] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:28 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:28.770290 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-640e97c2-caa6-4bab-b5af-abbb39de4b8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:28.775807 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-640e97c2-caa6-4bab-b5af-abbb39de4b8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:28.793520 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-640e97c2-caa6-4bab-b5af-abbb39de4b8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:28.795707 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-640e97c2-caa6-4bab-b5af-abbb39de4b8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:28.799224 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-640e97c2-caa6-4bab-b5af-abbb39de4b8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:28.800666 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-640e97c2-caa6-4bab-b5af-abbb39de4b8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:29.306359 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-640e97c2-caa6-4bab-b5af-abbb39de4b8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:29.344910 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-640e97c2-caa6-4bab-b5af-abbb39de4b8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:29.355345 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-640e97c2-caa6-4bab-b5af-abbb39de4b8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:29.356846 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-640e97c2-caa6-4bab-b5af-abbb39de4b8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1332 microversion: 2.20 time: 0.593874 Aug 24 19:30:29.372002 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 29/70] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:28 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1332 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:29.398052 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5a73a0bb-bae5-4c58-9e26-ce94b4ebcd8d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:29.406034 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5a73a0bb-bae5-4c58-9e26-ce94b4ebcd8d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:29.780777 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e2128c58-d42c-42a5-ac87-21eee9836214 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:29.797699 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e2128c58-d42c-42a5-ac87-21eee9836214 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 1.316937 Aug 24 19:30:29.798539 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 42/71] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:28 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:29.813990 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5a73a0bb-bae5-4c58-9e26-ce94b4ebcd8d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:29.823707 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5a73a0bb-bae5-4c58-9e26-ce94b4ebcd8d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1237 microversion: 2.1 time: 0.457050 Aug 24 19:30:29.825334 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f3ec2e8f-95dd-46fd-a143-976dacf53eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:29.826139 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 30/72] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:29 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1237 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:29.829265 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f3ec2e8f-95dd-46fd-a143-976dacf53eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:29.835025 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f318abfa-2fa5-4fcd-a014-a44915f85e26 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:29.835025 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f318abfa-2fa5-4fcd-a014-a44915f85e26 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:29.840205 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f3ec2e8f-95dd-46fd-a143-976dacf53eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:29.842691 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f3ec2e8f-95dd-46fd-a143-976dacf53eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:29.843642 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f3ec2e8f-95dd-46fd-a143-976dacf53eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:29.845623 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f3ec2e8f-95dd-46fd-a143-976dacf53eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:29.847094 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f318abfa-2fa5-4fcd-a014-a44915f85e26 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:29.847613 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f318abfa-2fa5-4fcd-a014-a44915f85e26 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:29.848570 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f318abfa-2fa5-4fcd-a014-a44915f85e26 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:29.849110 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f318abfa-2fa5-4fcd-a014-a44915f85e26 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:30.693456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f3ec2e8f-95dd-46fd-a143-976dacf53eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:30.701337 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f3ec2e8f-95dd-46fd-a143-976dacf53eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 0.891714 Aug 24 19:30:30.705681 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 43/73] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:29 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:30.716094 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4498e83f-b173-4da1-8dc1-4a4a7bebd282 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:30.717209 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4498e83f-b173-4da1-8dc1-4a4a7bebd282 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:30.724335 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4498e83f-b173-4da1-8dc1-4a4a7bebd282 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:30.724987 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4498e83f-b173-4da1-8dc1-4a4a7bebd282 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:30.726090 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4498e83f-b173-4da1-8dc1-4a4a7bebd282 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:30.726877 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4498e83f-b173-4da1-8dc1-4a4a7bebd282 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:30.741186 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f318abfa-2fa5-4fcd-a014-a44915f85e26 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:30.757645 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f318abfa-2fa5-4fcd-a014-a44915f85e26 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1322 microversion: 2.1 time: 0.930234 Aug 24 19:30:30.759508 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 31/74] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:29 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1322 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:30.765548 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-5a3fdc08-c6b9-4564-a225-43a080a1adea req-913e742c-a25f-4107-a925-dd15b717c106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd316c0d-59a0-4082-91a9-019af34e063b", "tag": "11aa4d8d-d272-4d56-a152-182570ea9cc9"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:30.768626 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:30:30.768626 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:30:30.830560 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-5a3fdc08-c6b9-4564-a225-43a080a1adea req-913e742c-a25f-4107-a925-dd15b717c106 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:30.833241 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-5a3fdc08-c6b9-4564-a225-43a080a1adea req-913e742c-a25f-4107-a925-dd15b717c106 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:30.898398 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-5a3fdc08-c6b9-4564-a225-43a080a1adea req-913e742c-a25f-4107-a925-dd15b717c106 service nova] Creating event network-changed:11aa4d8d-d272-4d56-a152-182570ea9cc9 for instance fd316c0d-59a0-4082-91a9-019af34e063b on hv-cinder-79819 Aug 24 19:30:30.905155 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-5a3fdc08-c6b9-4564-a225-43a080a1adea req-913e742c-a25f-4107-a925-dd15b717c106 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108907) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 24 19:30:30.906436 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8ce022ed-9a68-4a98-bc6d-cdeb114bfc57 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:30.907137 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8ce022ed-9a68-4a98-bc6d-cdeb114bfc57 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:30.908097 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8ce022ed-9a68-4a98-bc6d-cdeb114bfc57 None None] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:30.908846 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8ce022ed-9a68-4a98-bc6d-cdeb114bfc57 None None] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:30.920234 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.compute.rpcapi [None req-8ce022ed-9a68-4a98-bc6d-cdeb114bfc57 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 24 19:30:30.922384 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8ce022ed-9a68-4a98-bc6d-cdeb114bfc57 None None] Releasing lock "compute-rpcapi-router" {{(pid=108907) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 24 19:30:30.954482 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8ce022ed-9a68-4a98-bc6d-cdeb114bfc57 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193237 Aug 24 19:30:30.955405 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 32/75] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:30:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:30.961490 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7e537f1f-ab75-43fa-8ca1-058cc44cf6e6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:30.962847 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7e537f1f-ab75-43fa-8ca1-058cc44cf6e6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:30.970725 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7e537f1f-ab75-43fa-8ca1-058cc44cf6e6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:30.971289 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7e537f1f-ab75-43fa-8ca1-058cc44cf6e6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:30.972292 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7e537f1f-ab75-43fa-8ca1-058cc44cf6e6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:30.973019 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7e537f1f-ab75-43fa-8ca1-058cc44cf6e6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:30.985147 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4498e83f-b173-4da1-8dc1-4a4a7bebd282 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:31.003944 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4498e83f-b173-4da1-8dc1-4a4a7bebd282 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:31.006522 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4498e83f-b173-4da1-8dc1-4a4a7bebd282 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:31.007705 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4498e83f-b173-4da1-8dc1-4a4a7bebd282 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1338 microversion: 2.20 time: 0.300845 Aug 24 19:30:31.008496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 44/76] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:30 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1338 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:31.016716 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-16d79bcc-07ba-4155-9375-32f4f97e267e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:31.017329 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-16d79bcc-07ba-4155-9375-32f4f97e267e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:31.028365 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-16d79bcc-07ba-4155-9375-32f4f97e267e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:31.028816 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-16d79bcc-07ba-4155-9375-32f4f97e267e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:31.029610 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-16d79bcc-07ba-4155-9375-32f4f97e267e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:31.030034 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-16d79bcc-07ba-4155-9375-32f4f97e267e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:31.410876 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-16d79bcc-07ba-4155-9375-32f4f97e267e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:31.432052 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-16d79bcc-07ba-4155-9375-32f4f97e267e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1241 microversion: 2.1 time: 0.422691 Aug 24 19:30:31.437474 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 45/77] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:31 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1241 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:31.678487 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-e14a2b78-e1d0-4523-875f-a97fac3052b1 req-33ebeb46-d579-4f14-aebe-67964d263e03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b3252f0-c442-46e2-9da6-666aacad067c", "tag": "f205b3f4-2282-41d5-8ee6-7679e24a4176"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:31.686485 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:30:31.686485 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:30:31.727985 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-e14a2b78-e1d0-4523-875f-a97fac3052b1 req-33ebeb46-d579-4f14-aebe-67964d263e03 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:31.736809 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-e14a2b78-e1d0-4523-875f-a97fac3052b1 req-33ebeb46-d579-4f14-aebe-67964d263e03 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:31.764093 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-e14a2b78-e1d0-4523-875f-a97fac3052b1 req-33ebeb46-d579-4f14-aebe-67964d263e03 service nova] Creating event network-changed:f205b3f4-2282-41d5-8ee6-7679e24a4176 for instance 0b3252f0-c442-46e2-9da6-666aacad067c on hv-cinder-79819 Aug 24 19:30:31.783000 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-e14a2b78-e1d0-4523-875f-a97fac3052b1 req-33ebeb46-d579-4f14-aebe-67964d263e03 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.341130 Aug 24 19:30:31.789010 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 46/78] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:30:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:31.792127 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0f23edf5-f009-48a3-9a66-64ebe22f3871 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] Calling method '.version_select at 0x7f8df7fe2b80>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:31.888516 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0f23edf5-f009-48a3-9a66-64ebe22f3871 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/5643649e-d901-4115-aa0f-839fc5e1ee72" status: 200 len: 351 microversion: 2.1 time: 0.103097 Aug 24 19:30:31.890013 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 47/79] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:31 2021] GET /compute/v2.1/os-volumes/5643649e-d901-4115-aa0f-839fc5e1ee72 => generated 351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:31.901794 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-eb621d70-94f3-4781-b993-158d71479662 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:31.911519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-eb621d70-94f3-4781-b993-158d71479662 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:31.947991 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-eb621d70-94f3-4781-b993-158d71479662 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:31.947991 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-eb621d70-94f3-4781-b993-158d71479662 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:31.947991 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-eb621d70-94f3-4781-b993-158d71479662 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:31.948913 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-eb621d70-94f3-4781-b993-158d71479662 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:32.019622 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7e537f1f-ab75-43fa-8ca1-058cc44cf6e6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:32.038732 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7e537f1f-ab75-43fa-8ca1-058cc44cf6e6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 1.080838 Aug 24 19:30:32.043144 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 33/80] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:30 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:32.055817 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-34cdb210-39d1-4156-a975-3d7a8cf7ce5d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:32.060872 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-34cdb210-39d1-4156-a975-3d7a8cf7ce5d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:32.079133 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-34cdb210-39d1-4156-a975-3d7a8cf7ce5d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:32.081428 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-34cdb210-39d1-4156-a975-3d7a8cf7ce5d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:32.083071 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-34cdb210-39d1-4156-a975-3d7a8cf7ce5d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:32.084924 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-34cdb210-39d1-4156-a975-3d7a8cf7ce5d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:32.933689 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-34cdb210-39d1-4156-a975-3d7a8cf7ce5d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:32.937943 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-eb621d70-94f3-4781-b993-158d71479662 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:32.948123 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-34cdb210-39d1-4156-a975-3d7a8cf7ce5d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1322 microversion: 2.1 time: 0.903554 Aug 24 19:30:32.951810 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-eb621d70-94f3-4781-b993-158d71479662 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 1.058435 Aug 24 19:30:32.955523 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 48/81] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:31 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:32.961479 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 34/82] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:32 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1322 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:32.965752 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d47e4b59-dd04-4f22-9e11-d6562b297938 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:32.968897 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d47e4b59-dd04-4f22-9e11-d6562b297938 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:32.970621 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-53340734-110f-4407-8b43-64c246a57cdd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:32.984044 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-53340734-110f-4407-8b43-64c246a57cdd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:32.989190 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d47e4b59-dd04-4f22-9e11-d6562b297938 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:32.989190 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d47e4b59-dd04-4f22-9e11-d6562b297938 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:32.991441 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d47e4b59-dd04-4f22-9e11-d6562b297938 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:32.992204 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d47e4b59-dd04-4f22-9e11-d6562b297938 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:33.000707 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-53340734-110f-4407-8b43-64c246a57cdd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:33.002289 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-53340734-110f-4407-8b43-64c246a57cdd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:33.004162 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-53340734-110f-4407-8b43-64c246a57cdd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:33.006121 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-53340734-110f-4407-8b43-64c246a57cdd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:33.273551 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-53340734-110f-4407-8b43-64c246a57cdd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:33.276637 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d47e4b59-dd04-4f22-9e11-d6562b297938 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:33.278286 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-53340734-110f-4407-8b43-64c246a57cdd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1295 microversion: 2.1 time: 0.315633 Aug 24 19:30:33.282579 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 35/83] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:32 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1295 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:33.302382 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-dc312543-fa16-4a71-9a93-067de94539b8 req-4535cf93-6168-4460-9d07-f8f2394e8e3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "649b4ff1-abbd-4ccb-8b5a-9ba24f560372", "tag": "c7975fe5-d0d9-4c7d-a3b8-f11f1f55a395"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:33.304023 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:30:33.304023 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:30:33.309394 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d47e4b59-dd04-4f22-9e11-d6562b297938 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:33.311720 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d47e4b59-dd04-4f22-9e11-d6562b297938 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:33.313081 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d47e4b59-dd04-4f22-9e11-d6562b297938 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1338 microversion: 2.20 time: 0.355813 Aug 24 19:30:33.321579 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-dc312543-fa16-4a71-9a93-067de94539b8 req-4535cf93-6168-4460-9d07-f8f2394e8e3c service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:33.322302 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-dc312543-fa16-4a71-9a93-067de94539b8 req-4535cf93-6168-4460-9d07-f8f2394e8e3c service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:33.326135 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 49/84] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:32 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1338 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:33.331491 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-70d29976-b269-4462-b69b-ed1860aec36f tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:33.332492 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-70d29976-b269-4462-b69b-ed1860aec36f tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:33.339760 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-70d29976-b269-4462-b69b-ed1860aec36f tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:33.342211 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-70d29976-b269-4462-b69b-ed1860aec36f tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:33.342211 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-70d29976-b269-4462-b69b-ed1860aec36f tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:33.342211 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-70d29976-b269-4462-b69b-ed1860aec36f tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:33.343161 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-dc312543-fa16-4a71-9a93-067de94539b8 req-4535cf93-6168-4460-9d07-f8f2394e8e3c service nova] Creating event network-changed:c7975fe5-d0d9-4c7d-a3b8-f11f1f55a395 for instance 649b4ff1-abbd-4ccb-8b5a-9ba24f560372 on hv-cinder-79819 Aug 24 19:30:33.349733 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-dc312543-fa16-4a71-9a93-067de94539b8 req-4535cf93-6168-4460-9d07-f8f2394e8e3c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064521 Aug 24 19:30:33.350918 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 36/85] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:30:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:33.973890 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c02e91b2-2515-40d2-bba4-9e5df10b334c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:33.975365 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c02e91b2-2515-40d2-bba4-9e5df10b334c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:33.983777 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c02e91b2-2515-40d2-bba4-9e5df10b334c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:34.004944 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c02e91b2-2515-40d2-bba4-9e5df10b334c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:34.007597 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c02e91b2-2515-40d2-bba4-9e5df10b334c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:34.009844 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c02e91b2-2515-40d2-bba4-9e5df10b334c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:34.157625 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-70d29976-b269-4462-b69b-ed1860aec36f tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:34.174090 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-70d29976-b269-4462-b69b-ed1860aec36f tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 0.846547 Aug 24 19:30:34.174688 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 50/86] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:33 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:34.179970 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-91c920a4-4f1e-401a-aa98-7935fdb49d1f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:34.181160 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-91c920a4-4f1e-401a-aa98-7935fdb49d1f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:34.190810 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-91c920a4-4f1e-401a-aa98-7935fdb49d1f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:34.191532 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-91c920a4-4f1e-401a-aa98-7935fdb49d1f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:34.192335 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-91c920a4-4f1e-401a-aa98-7935fdb49d1f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:34.192905 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-91c920a4-4f1e-401a-aa98-7935fdb49d1f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:34.818588 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c02e91b2-2515-40d2-bba4-9e5df10b334c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:34.836442 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c02e91b2-2515-40d2-bba4-9e5df10b334c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1322 microversion: 2.1 time: 0.868616 Aug 24 19:30:34.846023 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 37/87] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:33 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1322 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:34.856806 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9c3e9fa4-cf74-426a-9b07-929b0e975b60 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] Calling method '.version_select at 0x7f8df77f2280>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:35.084608 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-91c920a4-4f1e-401a-aa98-7935fdb49d1f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:35.090690 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-91c920a4-4f1e-401a-aa98-7935fdb49d1f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 0.914701 Aug 24 19:30:35.091481 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 51/88] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:34 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:35.118605 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2d7efed5-9c7a-438c-ad2e-22cf7e6a373c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:35.119824 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2d7efed5-9c7a-438c-ad2e-22cf7e6a373c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:35.141224 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2d7efed5-9c7a-438c-ad2e-22cf7e6a373c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:35.142007 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2d7efed5-9c7a-438c-ad2e-22cf7e6a373c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:35.143388 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2d7efed5-9c7a-438c-ad2e-22cf7e6a373c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:35.144145 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2d7efed5-9c7a-438c-ad2e-22cf7e6a373c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:35.183662 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9c3e9fa4-cf74-426a-9b07-929b0e975b60 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/11a466f4-61ce-4d1e-ab1d-82a52aa57300" status: 200 len: 351 microversion: 2.1 time: 0.342162 Aug 24 19:30:35.184518 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 38/89] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:30:34 2021] GET /compute/v2.1/os-volumes/11a466f4-61ce-4d1e-ab1d-82a52aa57300 => generated 351 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:35.190661 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a2d3ee10-dd8c-4d9c-ab5a-9dd423fc2ea6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:35.191540 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a2d3ee10-dd8c-4d9c-ab5a-9dd423fc2ea6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:35.210089 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a2d3ee10-dd8c-4d9c-ab5a-9dd423fc2ea6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:35.212394 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a2d3ee10-dd8c-4d9c-ab5a-9dd423fc2ea6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:35.213546 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a2d3ee10-dd8c-4d9c-ab5a-9dd423fc2ea6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:35.214674 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a2d3ee10-dd8c-4d9c-ab5a-9dd423fc2ea6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:35.950571 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-2d7efed5-9c7a-438c-ad2e-22cf7e6a373c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:35.965523 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2d7efed5-9c7a-438c-ad2e-22cf7e6a373c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1362 microversion: 2.1 time: 0.871378 Aug 24 19:30:35.966115 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 52/90] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:35 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1362 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:35.975689 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-27506a8c-1b1c-49c4-b224-3034b5d7452f tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] Calling method '.version_select at 0x7f8df7f88a60>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:36.005361 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a2d3ee10-dd8c-4d9c-ab5a-9dd423fc2ea6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:36.024388 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a2d3ee10-dd8c-4d9c-ab5a-9dd423fc2ea6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:36.029981 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a2d3ee10-dd8c-4d9c-ab5a-9dd423fc2ea6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:36.031835 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a2d3ee10-dd8c-4d9c-ab5a-9dd423fc2ea6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1406 microversion: 2.20 time: 0.845573 Aug 24 19:30:36.033417 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 39/91] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:35 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1406 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:36.038179 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c5e78951-baa2-446e-8b4b-099a59f27f68 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:36.038779 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c5e78951-baa2-446e-8b4b-099a59f27f68 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:36.047203 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c5e78951-baa2-446e-8b4b-099a59f27f68 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:36.048064 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c5e78951-baa2-446e-8b4b-099a59f27f68 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:36.049978 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c5e78951-baa2-446e-8b4b-099a59f27f68 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:36.050587 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c5e78951-baa2-446e-8b4b-099a59f27f68 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:36.119801 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-27506a8c-1b1c-49c4-b224-3034b5d7452f tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.151977 Aug 24 19:30:36.120577 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 53/92] 10.222.0.59 () {58 vars in 1134 bytes} [Tue Aug 24 19:30:35 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:36.126025 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-f788467f-36a9-43e2-a82b-109aa8933e7a req-d12c68fd-7e34-4619-90f7-baa7829d1e09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01", "tag": "adfe6c55-fc59-4263-be71-0135828820e8"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:36.127763 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:30:36.127763 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:30:36.138183 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-f788467f-36a9-43e2-a82b-109aa8933e7a req-d12c68fd-7e34-4619-90f7-baa7829d1e09 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:36.139651 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-f788467f-36a9-43e2-a82b-109aa8933e7a req-d12c68fd-7e34-4619-90f7-baa7829d1e09 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:36.156102 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-f788467f-36a9-43e2-a82b-109aa8933e7a req-d12c68fd-7e34-4619-90f7-baa7829d1e09 service nova] Creating event network-changed:adfe6c55-fc59-4263-be71-0135828820e8 for instance a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 on hv-cinder-79819 Aug 24 19:30:36.162002 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-f788467f-36a9-43e2-a82b-109aa8933e7a req-d12c68fd-7e34-4619-90f7-baa7829d1e09 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039833 Aug 24 19:30:36.162938 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 54/93] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:30:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:36.173078 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c4ce634f-ef97-4e7a-a037-4913f7aa6450 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:36.173949 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-c4ce634f-ef97-4e7a-a037-4913f7aa6450 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:36.183445 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c4ce634f-ef97-4e7a-a037-4913f7aa6450 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:36.184093 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c4ce634f-ef97-4e7a-a037-4913f7aa6450 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:36.185083 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c4ce634f-ef97-4e7a-a037-4913f7aa6450 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:36.185526 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c4ce634f-ef97-4e7a-a037-4913f7aa6450 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:36.273830 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c5e78951-baa2-446e-8b4b-099a59f27f68 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:36.282700 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c5e78951-baa2-446e-8b4b-099a59f27f68 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 0.247996 Aug 24 19:30:36.284302 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 40/94] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:36 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:36.289472 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7cfa9dd1-f288-46ce-b083-3f9bda9efe71 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:36.290193 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7cfa9dd1-f288-46ce-b083-3f9bda9efe71 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:36.298073 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7cfa9dd1-f288-46ce-b083-3f9bda9efe71 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:36.299966 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7cfa9dd1-f288-46ce-b083-3f9bda9efe71 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:36.299966 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7cfa9dd1-f288-46ce-b083-3f9bda9efe71 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:36.300156 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7cfa9dd1-f288-46ce-b083-3f9bda9efe71 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:36.377255 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-c4ce634f-ef97-4e7a-a037-4913f7aa6450 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:36.386125 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c4ce634f-ef97-4e7a-a037-4913f7aa6450 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1322 microversion: 2.1 time: 0.221698 Aug 24 19:30:36.389856 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 55/95] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:36 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:36.395323 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-bc734937-77bd-4dd6-a02f-e0d61f53e570 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] Calling method '.version_select at 0x7f8df7f88430>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:36.520177 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-bc734937-77bd-4dd6-a02f-e0d61f53e570 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.129978 Aug 24 19:30:36.521473 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 56/96] 10.222.0.59 () {58 vars in 1149 bytes} [Tue Aug 24 19:30:36 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:36.538824 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d10d4f49-7f96-456d-b9c3-cabadcb3ab17 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] Calling method '.version_select at 0x7f8df7fb4ca0>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:36.559162 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7cfa9dd1-f288-46ce-b083-3f9bda9efe71 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:36.573459 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7cfa9dd1-f288-46ce-b083-3f9bda9efe71 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 0.287752 Aug 24 19:30:36.591400 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 41/97] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:36 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:36.657224 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d10d4f49-7f96-456d-b9c3-cabadcb3ab17 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.128122 Aug 24 19:30:36.657803 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 57/98] 10.222.0.59 () {58 vars in 1134 bytes} [Tue Aug 24 19:30:36 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:36.671048 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-99115e18-6397-49c3-8d1b-b94dc41a5e83 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] Calling method '.version_select at 0x7f8df77453a0>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:36.764305 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-99115e18-6397-49c3-8d1b-b94dc41a5e83 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.097133 Aug 24 19:30:36.764917 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 42/99] 10.222.0.59 () {58 vars in 1167 bytes} [Tue Aug 24 19:30:36 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:36.776289 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c3ee32c5-025b-4426-8b1c-dd96723eabdd tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] Calling method '.version_select at 0x7f8df7fe2e50>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:36.879023 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c3ee32c5-025b-4426-8b1c-dd96723eabdd tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.106107 Aug 24 19:30:36.879948 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 58/100] 10.222.0.59 () {58 vars in 1170 bytes} [Tue Aug 24 19:30:36 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:36.893210 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4bdae0cb-27de-4599-8938-e895e2240c04 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] Calling method '.version_select at 0x7f8df770a940>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:36.910567 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-979e2fee-46b9-4ae1-b661-4700a0bb87ed req-cb3b2674-bc6e-4201-af21-5719f4816e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c70c776-ec7a-4970-9d9f-baf8c6568257", "tag": "39906ad8-eb91-4f23-8e1c-cbdd3d7aa570"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:36.917555 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:30:36.917555 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:30:36.952659 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-979e2fee-46b9-4ae1-b661-4700a0bb87ed req-cb3b2674-bc6e-4201-af21-5719f4816e4c service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:36.954382 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-979e2fee-46b9-4ae1-b661-4700a0bb87ed req-cb3b2674-bc6e-4201-af21-5719f4816e4c service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:36.979358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-979e2fee-46b9-4ae1-b661-4700a0bb87ed req-cb3b2674-bc6e-4201-af21-5719f4816e4c service nova] Creating event network-changed:39906ad8-eb91-4f23-8e1c-cbdd3d7aa570 for instance 7c70c776-ec7a-4970-9d9f-baf8c6568257 on hv-cinder-79819 Aug 24 19:30:36.985193 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-979e2fee-46b9-4ae1-b661-4700a0bb87ed req-cb3b2674-bc6e-4201-af21-5719f4816e4c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083544 Aug 24 19:30:36.988995 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 59/101] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:30:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:36.994519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-88eb8aa0-41af-42e5-9560-12746c9e121b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:36.995243 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-88eb8aa0-41af-42e5-9560-12746c9e121b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:37.002299 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-88eb8aa0-41af-42e5-9560-12746c9e121b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:37.004307 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-88eb8aa0-41af-42e5-9560-12746c9e121b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:37.004307 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-88eb8aa0-41af-42e5-9560-12746c9e121b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:37.004307 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-88eb8aa0-41af-42e5-9560-12746c9e121b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:37.054753 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4bdae0cb-27de-4599-8938-e895e2240c04 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.165819 Aug 24 19:30:37.064351 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 43/102] 10.222.0.59 () {58 vars in 1155 bytes} [Tue Aug 24 19:30:36 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:37.070028 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-2a62f2c1-8a5e-4d5d-b29a-5308afa0296e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:37.070889 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-2a62f2c1-8a5e-4d5d-b29a-5308afa0296e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:37.080081 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2a62f2c1-8a5e-4d5d-b29a-5308afa0296e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:37.080817 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2a62f2c1-8a5e-4d5d-b29a-5308afa0296e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:37.083301 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2a62f2c1-8a5e-4d5d-b29a-5308afa0296e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:37.083935 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2a62f2c1-8a5e-4d5d-b29a-5308afa0296e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:37.234887 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-88eb8aa0-41af-42e5-9560-12746c9e121b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:37.242616 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-88eb8aa0-41af-42e5-9560-12746c9e121b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1362 microversion: 2.1 time: 0.252261 Aug 24 19:30:37.243301 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 60/103] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:36 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1362 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:37.249150 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3004c6cb-8102-431d-81c4-ceac0132f318 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] Calling method '.version_select at 0x7f8df7fb48b0>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:37.344809 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3004c6cb-8102-431d-81c4-ceac0132f318 tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.100131 Aug 24 19:30:37.347376 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2a62f2c1-8a5e-4d5d-b29a-5308afa0296e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:37.352418 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 61/104] 10.222.0.59 () {58 vars in 1188 bytes} [Tue Aug 24 19:30:37 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:37.357432 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-283d1feb-665f-45d6-81f6-af04d95a94b5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:37.358176 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-283d1feb-665f-45d6-81f6-af04d95a94b5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:37.363915 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2a62f2c1-8a5e-4d5d-b29a-5308afa0296e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:37.364580 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-283d1feb-665f-45d6-81f6-af04d95a94b5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:37.365199 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-283d1feb-665f-45d6-81f6-af04d95a94b5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:37.366122 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-283d1feb-665f-45d6-81f6-af04d95a94b5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:37.366716 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-283d1feb-665f-45d6-81f6-af04d95a94b5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:37.369331 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2a62f2c1-8a5e-4d5d-b29a-5308afa0296e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:37.370498 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-2a62f2c1-8a5e-4d5d-b29a-5308afa0296e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1406 microversion: 2.20 time: 0.305053 Aug 24 19:30:37.371063 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 44/105] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:37 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:37.378890 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d31a1c22-ca11-4495-a817-12eb27d43cce tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] Calling method '.version_select at 0x7f8df770a550>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:37.470502 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d31a1c22-ca11-4495-a817-12eb27d43cce tempest-VolumesTestJSON-813665075 tempest-VolumesTestJSON-813665075-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.098378 Aug 24 19:30:37.474352 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 45/106] 10.222.0.59 () {58 vars in 1155 bytes} [Tue Aug 24 19:30:37 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:37.476140 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9493df1f-a532-4d95-800b-f6e73bf1521c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:37.477664 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9493df1f-a532-4d95-800b-f6e73bf1521c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:37.484933 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9493df1f-a532-4d95-800b-f6e73bf1521c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:37.485544 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9493df1f-a532-4d95-800b-f6e73bf1521c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:37.486556 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9493df1f-a532-4d95-800b-f6e73bf1521c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:37.487128 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9493df1f-a532-4d95-800b-f6e73bf1521c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:37.594118 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-283d1feb-665f-45d6-81f6-af04d95a94b5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:37.603439 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-283d1feb-665f-45d6-81f6-af04d95a94b5 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 0.248146 Aug 24 19:30:37.608585 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 62/107] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:37 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:37.616144 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-7b38f172-703f-4e61-95a7-d5ceab0876f5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:37.616954 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-7b38f172-703f-4e61-95a7-d5ceab0876f5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:37.623935 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7b38f172-703f-4e61-95a7-d5ceab0876f5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:37.624472 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7b38f172-703f-4e61-95a7-d5ceab0876f5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:37.625248 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7b38f172-703f-4e61-95a7-d5ceab0876f5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:37.625669 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7b38f172-703f-4e61-95a7-d5ceab0876f5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:37.644693 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9493df1f-a532-4d95-800b-f6e73bf1521c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:37.653458 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9493df1f-a532-4d95-800b-f6e73bf1521c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1322 microversion: 2.1 time: 0.181108 Aug 24 19:30:37.654161 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 46/108] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:37 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:37.773981 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-7b38f172-703f-4e61-95a7-d5ceab0876f5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:37.781968 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-7b38f172-703f-4e61-95a7-d5ceab0876f5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 0.172056 Aug 24 19:30:37.782647 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 63/109] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:37 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:38.261742 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5b7fccb5-8bf7-470f-a8f4-8f7a36974d96 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:38.263127 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5b7fccb5-8bf7-470f-a8f4-8f7a36974d96 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:38.269475 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5b7fccb5-8bf7-470f-a8f4-8f7a36974d96 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:38.269979 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5b7fccb5-8bf7-470f-a8f4-8f7a36974d96 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:38.270948 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5b7fccb5-8bf7-470f-a8f4-8f7a36974d96 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:38.271371 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5b7fccb5-8bf7-470f-a8f4-8f7a36974d96 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:38.391989 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-46215def-d92a-46e1-9727-bf0c23b502ae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:38.392908 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-46215def-d92a-46e1-9727-bf0c23b502ae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:38.399086 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46215def-d92a-46e1-9727-bf0c23b502ae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:38.399923 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46215def-d92a-46e1-9727-bf0c23b502ae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:38.400767 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46215def-d92a-46e1-9727-bf0c23b502ae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:38.401191 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46215def-d92a-46e1-9727-bf0c23b502ae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:38.460747 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5b7fccb5-8bf7-470f-a8f4-8f7a36974d96 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:38.470060 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5b7fccb5-8bf7-470f-a8f4-8f7a36974d96 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1362 microversion: 2.1 time: 0.213215 Aug 24 19:30:38.470663 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 47/110] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:38 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:38.620606 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-89b8a69e-785e-4b54-b5eb-221ad7547f15 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:38.621380 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-89b8a69e-785e-4b54-b5eb-221ad7547f15 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:38.628771 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-89b8a69e-785e-4b54-b5eb-221ad7547f15 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:38.629213 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-89b8a69e-785e-4b54-b5eb-221ad7547f15 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:38.630318 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-89b8a69e-785e-4b54-b5eb-221ad7547f15 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:38.630413 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-89b8a69e-785e-4b54-b5eb-221ad7547f15 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:38.946444 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-46215def-d92a-46e1-9727-bf0c23b502ae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:38.955044 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-46215def-d92a-46e1-9727-bf0c23b502ae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:38.956578 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-46215def-d92a-46e1-9727-bf0c23b502ae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:38.957664 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-46215def-d92a-46e1-9727-bf0c23b502ae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1406 microversion: 2.20 time: 0.572496 Aug 24 19:30:38.958372 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 64/111] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:38 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1406 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:38.963888 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d177bc26-4323-4e12-bc6a-12fa214f9692 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:38.964681 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d177bc26-4323-4e12-bc6a-12fa214f9692 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:38.987258 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d177bc26-4323-4e12-bc6a-12fa214f9692 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:38.987710 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d177bc26-4323-4e12-bc6a-12fa214f9692 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:38.988523 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d177bc26-4323-4e12-bc6a-12fa214f9692 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:38.988947 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d177bc26-4323-4e12-bc6a-12fa214f9692 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:39.118380 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-89b8a69e-785e-4b54-b5eb-221ad7547f15 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:39.127786 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-89b8a69e-785e-4b54-b5eb-221ad7547f15 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 0.511244 Aug 24 19:30:39.128406 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 48/112] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:38 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:39.136509 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ec279db4-70b8-4ce7-b304-ccecd901e25d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:39.136509 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ec279db4-70b8-4ce7-b304-ccecd901e25d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:39.140316 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ec279db4-70b8-4ce7-b304-ccecd901e25d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:39.140777 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ec279db4-70b8-4ce7-b304-ccecd901e25d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:39.141559 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ec279db4-70b8-4ce7-b304-ccecd901e25d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:39.144210 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ec279db4-70b8-4ce7-b304-ccecd901e25d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:39.181863 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d177bc26-4323-4e12-bc6a-12fa214f9692 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:39.190557 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d177bc26-4323-4e12-bc6a-12fa214f9692 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1322 microversion: 2.1 time: 0.229951 Aug 24 19:30:39.191149 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 65/113] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:38 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:39.316554 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ec279db4-70b8-4ce7-b304-ccecd901e25d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:39.324346 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ec279db4-70b8-4ce7-b304-ccecd901e25d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 0.194696 Aug 24 19:30:39.324941 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 49/114] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:39 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:39.487035 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-339e15aa-0fcb-465c-a5b9-78567c1d8a6a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:39.487599 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-339e15aa-0fcb-465c-a5b9-78567c1d8a6a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:39.493919 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-339e15aa-0fcb-465c-a5b9-78567c1d8a6a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:39.494368 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-339e15aa-0fcb-465c-a5b9-78567c1d8a6a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:39.495161 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-339e15aa-0fcb-465c-a5b9-78567c1d8a6a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:39.495595 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-339e15aa-0fcb-465c-a5b9-78567c1d8a6a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:39.633727 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-339e15aa-0fcb-465c-a5b9-78567c1d8a6a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:39.642162 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-339e15aa-0fcb-465c-a5b9-78567c1d8a6a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1362 microversion: 2.1 time: 0.158782 Aug 24 19:30:39.643060 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 66/115] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:39 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:39.978697 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-79d1aaf7-11de-4e7d-8006-1449f231db53 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:39.979509 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-79d1aaf7-11de-4e7d-8006-1449f231db53 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:39.985316 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-79d1aaf7-11de-4e7d-8006-1449f231db53 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:39.985759 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-79d1aaf7-11de-4e7d-8006-1449f231db53 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:39.986694 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-79d1aaf7-11de-4e7d-8006-1449f231db53 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:39.987288 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-79d1aaf7-11de-4e7d-8006-1449f231db53 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:40.122699 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-79d1aaf7-11de-4e7d-8006-1449f231db53 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:40.135251 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-79d1aaf7-11de-4e7d-8006-1449f231db53 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:40.136824 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-79d1aaf7-11de-4e7d-8006-1449f231db53 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:40.137927 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-79d1aaf7-11de-4e7d-8006-1449f231db53 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1406 microversion: 2.20 time: 0.163062 Aug 24 19:30:40.145349 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-92431a7d-bcfd-4fc0-8367-531390e6f875 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:40.146111 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-92431a7d-bcfd-4fc0-8367-531390e6f875 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:40.148887 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 50/116] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:39 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:40.152297 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-92431a7d-bcfd-4fc0-8367-531390e6f875 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:40.152753 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-92431a7d-bcfd-4fc0-8367-531390e6f875 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:40.153519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-92431a7d-bcfd-4fc0-8367-531390e6f875 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:40.154013 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-92431a7d-bcfd-4fc0-8367-531390e6f875 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:40.206655 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a810c0e6-ada0-412d-948d-f77b6a91577a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:40.212297 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a810c0e6-ada0-412d-948d-f77b6a91577a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:40.224056 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a810c0e6-ada0-412d-948d-f77b6a91577a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:40.224548 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a810c0e6-ada0-412d-948d-f77b6a91577a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:40.225452 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a810c0e6-ada0-412d-948d-f77b6a91577a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:40.225887 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a810c0e6-ada0-412d-948d-f77b6a91577a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:40.326558 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-92431a7d-bcfd-4fc0-8367-531390e6f875 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:40.340284 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-92431a7d-bcfd-4fc0-8367-531390e6f875 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 0.192761 Aug 24 19:30:40.340284 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 67/117] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:40 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:40.346487 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1c4c1641-40d1-4610-af28-984a9432bfc5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:40.346487 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1c4c1641-40d1-4610-af28-984a9432bfc5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:40.349980 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c4c1641-40d1-4610-af28-984a9432bfc5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:40.350423 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c4c1641-40d1-4610-af28-984a9432bfc5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:40.351195 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c4c1641-40d1-4610-af28-984a9432bfc5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:40.351626 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c4c1641-40d1-4610-af28-984a9432bfc5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:40.430288 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a810c0e6-ada0-412d-948d-f77b6a91577a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:40.438287 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a810c0e6-ada0-412d-948d-f77b6a91577a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1322 microversion: 2.1 time: 0.235195 Aug 24 19:30:40.442124 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 51/118] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:40 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:40.563458 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1c4c1641-40d1-4610-af28-984a9432bfc5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:40.574514 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1c4c1641-40d1-4610-af28-984a9432bfc5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 0.235756 Aug 24 19:30:40.585112 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 68/119] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:40 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:40.663200 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ca5846c5-180e-44fa-8616-15930b92d358 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:40.667179 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ca5846c5-180e-44fa-8616-15930b92d358 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:40.670984 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ca5846c5-180e-44fa-8616-15930b92d358 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:40.671737 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ca5846c5-180e-44fa-8616-15930b92d358 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:40.672637 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ca5846c5-180e-44fa-8616-15930b92d358 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:40.673147 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ca5846c5-180e-44fa-8616-15930b92d358 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:40.817115 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ca5846c5-180e-44fa-8616-15930b92d358 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:40.825515 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ca5846c5-180e-44fa-8616-15930b92d358 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1362 microversion: 2.1 time: 0.165879 Aug 24 19:30:40.835320 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 52/120] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:40 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:41.156163 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a469a295-4eaa-4d4c-870d-688e267a5b58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:41.156827 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a469a295-4eaa-4d4c-870d-688e267a5b58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:41.162822 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a469a295-4eaa-4d4c-870d-688e267a5b58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:41.163270 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a469a295-4eaa-4d4c-870d-688e267a5b58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:41.164033 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a469a295-4eaa-4d4c-870d-688e267a5b58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:41.165042 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a469a295-4eaa-4d4c-870d-688e267a5b58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:41.284698 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a469a295-4eaa-4d4c-870d-688e267a5b58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:41.292453 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a469a295-4eaa-4d4c-870d-688e267a5b58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:41.293941 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a469a295-4eaa-4d4c-870d-688e267a5b58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:41.295049 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a469a295-4eaa-4d4c-870d-688e267a5b58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1406 microversion: 2.20 time: 0.142682 Aug 24 19:30:41.299035 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 69/121] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:41 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1406 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:41.351595 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0c8bc63a-6a5a-4ced-9643-20fa19082062 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:41.352117 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0c8bc63a-6a5a-4ced-9643-20fa19082062 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:41.358518 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0c8bc63a-6a5a-4ced-9643-20fa19082062 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:41.359041 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0c8bc63a-6a5a-4ced-9643-20fa19082062 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:41.359811 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0c8bc63a-6a5a-4ced-9643-20fa19082062 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:41.360232 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0c8bc63a-6a5a-4ced-9643-20fa19082062 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:41.458129 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-00ef2b86-f7a0-4b22-8e65-c00b0ffe5c09 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:41.458730 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-00ef2b86-f7a0-4b22-8e65-c00b0ffe5c09 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:41.464772 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-00ef2b86-f7a0-4b22-8e65-c00b0ffe5c09 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:41.465210 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-00ef2b86-f7a0-4b22-8e65-c00b0ffe5c09 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:41.467419 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-00ef2b86-f7a0-4b22-8e65-c00b0ffe5c09 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:41.468435 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-00ef2b86-f7a0-4b22-8e65-c00b0ffe5c09 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:41.481748 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0c8bc63a-6a5a-4ced-9643-20fa19082062 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:41.498945 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0c8bc63a-6a5a-4ced-9643-20fa19082062 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 0.151039 Aug 24 19:30:41.511772 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 53/122] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:41 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:41.592721 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1f9bacdf-a30a-43f1-b828-4cda2d3378f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:41.593541 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1f9bacdf-a30a-43f1-b828-4cda2d3378f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:41.600464 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1f9bacdf-a30a-43f1-b828-4cda2d3378f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:41.601144 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1f9bacdf-a30a-43f1-b828-4cda2d3378f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:41.602147 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1f9bacdf-a30a-43f1-b828-4cda2d3378f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:41.602783 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1f9bacdf-a30a-43f1-b828-4cda2d3378f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:41.770842 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-00ef2b86-f7a0-4b22-8e65-c00b0ffe5c09 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:41.787494 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-00ef2b86-f7a0-4b22-8e65-c00b0ffe5c09 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1322 microversion: 2.1 time: 0.332007 Aug 24 19:30:41.791268 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 70/123] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:41 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:41.843165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d99cf0f1-415c-47ce-bd0c-1a8c8330d5aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:41.844010 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d99cf0f1-415c-47ce-bd0c-1a8c8330d5aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:41.857528 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d99cf0f1-415c-47ce-bd0c-1a8c8330d5aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:41.857965 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d99cf0f1-415c-47ce-bd0c-1a8c8330d5aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:41.858844 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d99cf0f1-415c-47ce-bd0c-1a8c8330d5aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:41.859670 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d99cf0f1-415c-47ce-bd0c-1a8c8330d5aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:41.930016 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1f9bacdf-a30a-43f1-b828-4cda2d3378f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:41.939812 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1f9bacdf-a30a-43f1-b828-4cda2d3378f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 0.351314 Aug 24 19:30:41.949736 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 54/124] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:41 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:42.106666 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d99cf0f1-415c-47ce-bd0c-1a8c8330d5aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:42.118646 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d99cf0f1-415c-47ce-bd0c-1a8c8330d5aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1362 microversion: 2.1 time: 0.277455 Aug 24 19:30:42.118646 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 71/125] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:41 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:42.314878 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-08be13eb-44e9-4e80-8964-6a0c87975637 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:42.315819 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-08be13eb-44e9-4e80-8964-6a0c87975637 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:42.323095 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-08be13eb-44e9-4e80-8964-6a0c87975637 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:42.323546 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-08be13eb-44e9-4e80-8964-6a0c87975637 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:42.324535 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-08be13eb-44e9-4e80-8964-6a0c87975637 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:42.324946 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-08be13eb-44e9-4e80-8964-6a0c87975637 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:42.468940 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-08be13eb-44e9-4e80-8964-6a0c87975637 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:42.479093 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-08be13eb-44e9-4e80-8964-6a0c87975637 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:42.480609 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-08be13eb-44e9-4e80-8964-6a0c87975637 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:42.481751 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-08be13eb-44e9-4e80-8964-6a0c87975637 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1406 microversion: 2.20 time: 0.170800 Aug 24 19:30:42.482809 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 55/126] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:42 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:42.515568 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9fafc3df-0f6b-4ded-bf3a-69cf81234c54 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:42.516290 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9fafc3df-0f6b-4ded-bf3a-69cf81234c54 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:42.522303 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9fafc3df-0f6b-4ded-bf3a-69cf81234c54 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:42.522846 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9fafc3df-0f6b-4ded-bf3a-69cf81234c54 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:42.523900 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9fafc3df-0f6b-4ded-bf3a-69cf81234c54 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:42.524540 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9fafc3df-0f6b-4ded-bf3a-69cf81234c54 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:42.645054 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9fafc3df-0f6b-4ded-bf3a-69cf81234c54 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:42.652386 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9fafc3df-0f6b-4ded-bf3a-69cf81234c54 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 0.140950 Aug 24 19:30:42.652957 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 72/127] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:42 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:42.805816 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ea3c02ed-b553-4c68-bf64-83318d0e31f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:42.806425 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ea3c02ed-b553-4c68-bf64-83318d0e31f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:42.812811 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea3c02ed-b553-4c68-bf64-83318d0e31f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:42.813157 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea3c02ed-b553-4c68-bf64-83318d0e31f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:42.813931 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea3c02ed-b553-4c68-bf64-83318d0e31f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:42.814357 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea3c02ed-b553-4c68-bf64-83318d0e31f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:42.947079 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ea3c02ed-b553-4c68-bf64-83318d0e31f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:42.955349 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ea3c02ed-b553-4c68-bf64-83318d0e31f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1322 microversion: 2.1 time: 0.153278 Aug 24 19:30:42.955931 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 56/128] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:42 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:42.957766 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8404da32-f875-402f-8dea-1c78da46b5d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:42.958452 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8404da32-f875-402f-8dea-1c78da46b5d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:42.964818 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8404da32-f875-402f-8dea-1c78da46b5d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:42.969181 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8404da32-f875-402f-8dea-1c78da46b5d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:42.969181 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8404da32-f875-402f-8dea-1c78da46b5d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:42.969181 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8404da32-f875-402f-8dea-1c78da46b5d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:43.087557 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8404da32-f875-402f-8dea-1c78da46b5d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:43.095346 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8404da32-f875-402f-8dea-1c78da46b5d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 0.141440 Aug 24 19:30:43.095962 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 73/129] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:42 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:43.133873 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-65a2659a-29aa-4896-9e32-f33fc5748ae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:43.134482 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-65a2659a-29aa-4896-9e32-f33fc5748ae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:43.140828 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-65a2659a-29aa-4896-9e32-f33fc5748ae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:43.141907 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-65a2659a-29aa-4896-9e32-f33fc5748ae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:43.142149 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-65a2659a-29aa-4896-9e32-f33fc5748ae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:43.142585 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-65a2659a-29aa-4896-9e32-f33fc5748ae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:43.271042 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-65a2659a-29aa-4896-9e32-f33fc5748ae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:43.278814 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-65a2659a-29aa-4896-9e32-f33fc5748ae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1362 microversion: 2.1 time: 0.148418 Aug 24 19:30:43.288659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 57/130] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:43 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:43.502193 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6bd260a2-e823-40a7-862a-95c812e379cf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:43.502193 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6bd260a2-e823-40a7-862a-95c812e379cf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:43.507373 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6bd260a2-e823-40a7-862a-95c812e379cf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:43.507884 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6bd260a2-e823-40a7-862a-95c812e379cf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:43.508745 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6bd260a2-e823-40a7-862a-95c812e379cf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:43.509169 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6bd260a2-e823-40a7-862a-95c812e379cf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:43.634832 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6bd260a2-e823-40a7-862a-95c812e379cf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:43.642933 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6bd260a2-e823-40a7-862a-95c812e379cf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:43.644511 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6bd260a2-e823-40a7-862a-95c812e379cf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:43.645600 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6bd260a2-e823-40a7-862a-95c812e379cf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1406 microversion: 2.20 time: 0.149470 Aug 24 19:30:43.646167 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 74/131] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:43 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:43.669670 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c145bdc4-3662-465d-aae6-5db6f84be30b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:43.670320 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c145bdc4-3662-465d-aae6-5db6f84be30b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:43.676438 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c145bdc4-3662-465d-aae6-5db6f84be30b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:43.676886 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c145bdc4-3662-465d-aae6-5db6f84be30b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:43.677655 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c145bdc4-3662-465d-aae6-5db6f84be30b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:43.678113 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c145bdc4-3662-465d-aae6-5db6f84be30b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:43.803695 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c145bdc4-3662-465d-aae6-5db6f84be30b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:43.811999 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c145bdc4-3662-465d-aae6-5db6f84be30b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 0.146528 Aug 24 19:30:43.812702 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 58/132] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:43 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:43.972748 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-01ef95e8-7ab3-427d-8ad9-2b616edc5604 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:43.973343 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-01ef95e8-7ab3-427d-8ad9-2b616edc5604 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:43.983068 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-01ef95e8-7ab3-427d-8ad9-2b616edc5604 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:43.983510 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-01ef95e8-7ab3-427d-8ad9-2b616edc5604 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:43.984322 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-01ef95e8-7ab3-427d-8ad9-2b616edc5604 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:43.984728 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-01ef95e8-7ab3-427d-8ad9-2b616edc5604 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:44.108991 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-01ef95e8-7ab3-427d-8ad9-2b616edc5604 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:44.112423 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-bb10de46-e63c-49a5-b7e2-533e9861afb7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:44.113027 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-bb10de46-e63c-49a5-b7e2-533e9861afb7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:44.116559 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-01ef95e8-7ab3-427d-8ad9-2b616edc5604 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1322 microversion: 2.1 time: 0.147415 Aug 24 19:30:44.117142 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 75/133] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:43 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:44.119605 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bb10de46-e63c-49a5-b7e2-533e9861afb7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:44.120046 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bb10de46-e63c-49a5-b7e2-533e9861afb7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:44.120885 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bb10de46-e63c-49a5-b7e2-533e9861afb7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:44.121291 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bb10de46-e63c-49a5-b7e2-533e9861afb7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:44.248104 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-bb10de46-e63c-49a5-b7e2-533e9861afb7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:44.255978 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-bb10de46-e63c-49a5-b7e2-533e9861afb7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 0.147106 Aug 24 19:30:44.256594 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 59/134] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:44 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:44.296987 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8824aa76-a4bf-44e7-9ddf-a31704ac1791 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:44.297600 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8824aa76-a4bf-44e7-9ddf-a31704ac1791 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:44.304406 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8824aa76-a4bf-44e7-9ddf-a31704ac1791 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:44.304859 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8824aa76-a4bf-44e7-9ddf-a31704ac1791 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:44.306665 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8824aa76-a4bf-44e7-9ddf-a31704ac1791 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:44.306665 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8824aa76-a4bf-44e7-9ddf-a31704ac1791 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:44.445024 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8824aa76-a4bf-44e7-9ddf-a31704ac1791 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:44.454320 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8824aa76-a4bf-44e7-9ddf-a31704ac1791 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1362 microversion: 2.1 time: 0.161810 Aug 24 19:30:44.464183 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 76/135] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:44 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:44.662946 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c7a4f430-76ce-46f6-b506-8bfc051bc603 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:44.663882 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c7a4f430-76ce-46f6-b506-8bfc051bc603 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:44.670172 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7a4f430-76ce-46f6-b506-8bfc051bc603 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:44.671319 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7a4f430-76ce-46f6-b506-8bfc051bc603 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:44.672112 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7a4f430-76ce-46f6-b506-8bfc051bc603 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:44.672606 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7a4f430-76ce-46f6-b506-8bfc051bc603 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:44.799407 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c7a4f430-76ce-46f6-b506-8bfc051bc603 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:44.808147 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c7a4f430-76ce-46f6-b506-8bfc051bc603 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:44.809636 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c7a4f430-76ce-46f6-b506-8bfc051bc603 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:44.810745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c7a4f430-76ce-46f6-b506-8bfc051bc603 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1406 microversion: 2.20 time: 0.151587 Aug 24 19:30:44.811296 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 60/136] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:44 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:44.838050 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-631dc34f-c203-4011-9a67-1a13d33fab81 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:44.838728 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-631dc34f-c203-4011-9a67-1a13d33fab81 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:44.846238 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-631dc34f-c203-4011-9a67-1a13d33fab81 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:44.849915 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-631dc34f-c203-4011-9a67-1a13d33fab81 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:44.849915 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-631dc34f-c203-4011-9a67-1a13d33fab81 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:44.849915 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-631dc34f-c203-4011-9a67-1a13d33fab81 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:45.006999 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-631dc34f-c203-4011-9a67-1a13d33fab81 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:45.015345 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-631dc34f-c203-4011-9a67-1a13d33fab81 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 0.180878 Aug 24 19:30:45.016238 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 77/137] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:44 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:45.104532 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-73ed2a2c-2f2c-4d20-b76b-e6bf6f3a6f5a req-a59802f1-6bbd-43ef-bb0a-3ef3413692c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3252f0-c442-46e2-9da6-666aacad067c", "name": "network-vif-plugged", "status": "completed", "tag": "f205b3f4-2282-41d5-8ee6-7679e24a4176"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:45.107530 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:30:45.107530 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:30:45.114602 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-73ed2a2c-2f2c-4d20-b76b-e6bf6f3a6f5a req-a59802f1-6bbd-43ef-bb0a-3ef3413692c6 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:45.115229 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-73ed2a2c-2f2c-4d20-b76b-e6bf6f3a6f5a req-a59802f1-6bbd-43ef-bb0a-3ef3413692c6 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:45.128256 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-73ed2a2c-2f2c-4d20-b76b-e6bf6f3a6f5a req-a59802f1-6bbd-43ef-bb0a-3ef3413692c6 service nova] Creating event network-vif-plugged:f205b3f4-2282-41d5-8ee6-7679e24a4176 for instance 0b3252f0-c442-46e2-9da6-666aacad067c on hv-cinder-79819 Aug 24 19:30:45.135715 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-73ed2a2c-2f2c-4d20-b76b-e6bf6f3a6f5a req-a59802f1-6bbd-43ef-bb0a-3ef3413692c6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086187 Aug 24 19:30:45.135715 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 61/138] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:30:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:45.136983 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-325d1691-19cb-4f8f-b835-7fb0a5d411b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:45.138193 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-325d1691-19cb-4f8f-b835-7fb0a5d411b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:45.157344 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-325d1691-19cb-4f8f-b835-7fb0a5d411b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:45.158019 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-325d1691-19cb-4f8f-b835-7fb0a5d411b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:45.158967 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-325d1691-19cb-4f8f-b835-7fb0a5d411b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:45.159401 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-325d1691-19cb-4f8f-b835-7fb0a5d411b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:45.274295 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-cb69d9ba-2a6a-4dbc-ae39-0d39a166e8f1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:45.275332 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-cb69d9ba-2a6a-4dbc-ae39-0d39a166e8f1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:45.286638 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cb69d9ba-2a6a-4dbc-ae39-0d39a166e8f1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:45.287092 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cb69d9ba-2a6a-4dbc-ae39-0d39a166e8f1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:45.288541 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cb69d9ba-2a6a-4dbc-ae39-0d39a166e8f1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:45.289041 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cb69d9ba-2a6a-4dbc-ae39-0d39a166e8f1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:45.300946 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-325d1691-19cb-4f8f-b835-7fb0a5d411b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:45.309450 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-325d1691-19cb-4f8f-b835-7fb0a5d411b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1322 microversion: 2.1 time: 0.177947 Aug 24 19:30:45.310127 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 78/139] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:45 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:45.444242 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-cb69d9ba-2a6a-4dbc-ae39-0d39a166e8f1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:45.457634 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-cb69d9ba-2a6a-4dbc-ae39-0d39a166e8f1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 0.186795 Aug 24 19:30:45.459055 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 62/140] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:45 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:45.471654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-66359352-5275-4000-8dd4-b72fc0890e7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:45.472662 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-66359352-5275-4000-8dd4-b72fc0890e7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:45.480683 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-66359352-5275-4000-8dd4-b72fc0890e7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:45.481371 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-66359352-5275-4000-8dd4-b72fc0890e7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:45.482603 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-66359352-5275-4000-8dd4-b72fc0890e7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:45.483336 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-66359352-5275-4000-8dd4-b72fc0890e7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:45.729091 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-66359352-5275-4000-8dd4-b72fc0890e7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:45.746343 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-66359352-5275-4000-8dd4-b72fc0890e7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1362 microversion: 2.1 time: 0.279104 Aug 24 19:30:45.757376 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 79/141] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:45 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:45.828928 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8a8307ab-1dbc-4639-820a-d9c0d09ee71c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:45.830110 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8a8307ab-1dbc-4639-820a-d9c0d09ee71c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:45.836390 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8a8307ab-1dbc-4639-820a-d9c0d09ee71c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:45.837048 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8a8307ab-1dbc-4639-820a-d9c0d09ee71c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:45.837809 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8a8307ab-1dbc-4639-820a-d9c0d09ee71c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:45.838231 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8a8307ab-1dbc-4639-820a-d9c0d09ee71c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:46.033619 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8a8307ab-1dbc-4639-820a-d9c0d09ee71c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:46.039504 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ca7c76c4-892d-4e20-b200-4cd0af363467 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:46.040435 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ca7c76c4-892d-4e20-b200-4cd0af363467 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:46.048144 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ca7c76c4-892d-4e20-b200-4cd0af363467 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:46.048804 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ca7c76c4-892d-4e20-b200-4cd0af363467 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:46.049979 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ca7c76c4-892d-4e20-b200-4cd0af363467 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:46.050862 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ca7c76c4-892d-4e20-b200-4cd0af363467 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:46.057178 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8a8307ab-1dbc-4639-820a-d9c0d09ee71c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:46.065168 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8a8307ab-1dbc-4639-820a-d9c0d09ee71c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:46.067679 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8a8307ab-1dbc-4639-820a-d9c0d09ee71c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1406 microversion: 2.20 time: 0.242660 Aug 24 19:30:46.069619 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 63/142] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:45 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:46.183050 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ca7c76c4-892d-4e20-b200-4cd0af363467 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:46.191211 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ca7c76c4-892d-4e20-b200-4cd0af363467 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 0.158346 Aug 24 19:30:46.191899 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 80/143] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:46 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:46.326487 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fb166819-30e8-4448-bb7e-8fbc2799008a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:46.327106 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fb166819-30e8-4448-bb7e-8fbc2799008a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:46.333525 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fb166819-30e8-4448-bb7e-8fbc2799008a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:46.333974 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fb166819-30e8-4448-bb7e-8fbc2799008a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:46.334774 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fb166819-30e8-4448-bb7e-8fbc2799008a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:46.335210 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fb166819-30e8-4448-bb7e-8fbc2799008a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:46.481222 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fb166819-30e8-4448-bb7e-8fbc2799008a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:46.490074 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-fb166819-30e8-4448-bb7e-8fbc2799008a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1322 microversion: 2.1 time: 0.167380 Aug 24 19:30:46.493960 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4db78e99-9f5d-40b7-91fd-e3b9bdd96ee4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:46.494739 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4db78e99-9f5d-40b7-91fd-e3b9bdd96ee4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:46.500180 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 64/144] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:46 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:46.501043 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4db78e99-9f5d-40b7-91fd-e3b9bdd96ee4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:46.508027 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4db78e99-9f5d-40b7-91fd-e3b9bdd96ee4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:46.508027 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4db78e99-9f5d-40b7-91fd-e3b9bdd96ee4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:46.508027 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4db78e99-9f5d-40b7-91fd-e3b9bdd96ee4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:46.628816 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4db78e99-9f5d-40b7-91fd-e3b9bdd96ee4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:46.636354 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4db78e99-9f5d-40b7-91fd-e3b9bdd96ee4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 0.165023 Aug 24 19:30:46.636925 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 81/145] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:46 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:46.764919 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-22c3f319-286a-42c9-88a7-39f9bc7248d0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:46.765526 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-22c3f319-286a-42c9-88a7-39f9bc7248d0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:46.771986 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-22c3f319-286a-42c9-88a7-39f9bc7248d0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:46.772384 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-22c3f319-286a-42c9-88a7-39f9bc7248d0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:46.773150 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-22c3f319-286a-42c9-88a7-39f9bc7248d0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:46.773569 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-22c3f319-286a-42c9-88a7-39f9bc7248d0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:46.897194 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-22c3f319-286a-42c9-88a7-39f9bc7248d0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:46.905111 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-22c3f319-286a-42c9-88a7-39f9bc7248d0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1362 microversion: 2.1 time: 0.144396 Aug 24 19:30:46.905686 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 65/146] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:46 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1362 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:47.085922 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a6fbfa36-28bd-41aa-a387-6ae2d2bff4e4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:47.086610 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a6fbfa36-28bd-41aa-a387-6ae2d2bff4e4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:47.092446 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6fbfa36-28bd-41aa-a387-6ae2d2bff4e4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:47.092886 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6fbfa36-28bd-41aa-a387-6ae2d2bff4e4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:47.093647 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6fbfa36-28bd-41aa-a387-6ae2d2bff4e4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:47.094073 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6fbfa36-28bd-41aa-a387-6ae2d2bff4e4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:47.163460 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-295919be-af5c-46a7-84e4-dc11ff7b1146 req-ca3b77b3-fafc-4232-897a-826c401832b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd316c0d-59a0-4082-91a9-019af34e063b", "name": "network-vif-plugged", "status": "completed", "tag": "11aa4d8d-d272-4d56-a152-182570ea9cc9"}, {"server_uuid": "649b4ff1-abbd-4ccb-8b5a-9ba24f560372", "name": "network-vif-plugged", "status": "completed", "tag": "c7975fe5-d0d9-4c7d-a3b8-f11f1f55a395"}, {"server_uuid": "ba289862-3027-492b-b4d1-d8539e4f3126", "name": "network-vif-plugged", "status": "completed", "tag": "f5cceb43-bd57-4a70-b5d7-600c3c4c3870"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:47.165491 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:30:47.165491 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:30:47.178624 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-295919be-af5c-46a7-84e4-dc11ff7b1146 req-ca3b77b3-fafc-4232-897a-826c401832b6 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:47.179082 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-295919be-af5c-46a7-84e4-dc11ff7b1146 req-ca3b77b3-fafc-4232-897a-826c401832b6 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:47.194864 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-295919be-af5c-46a7-84e4-dc11ff7b1146 req-ca3b77b3-fafc-4232-897a-826c401832b6 service nova] Creating event network-vif-plugged:11aa4d8d-d272-4d56-a152-182570ea9cc9 for instance fd316c0d-59a0-4082-91a9-019af34e063b on hv-cinder-79819 Aug 24 19:30:47.195677 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-295919be-af5c-46a7-84e4-dc11ff7b1146 req-ca3b77b3-fafc-4232-897a-826c401832b6 service nova] Creating event network-vif-plugged:c7975fe5-d0d9-4c7d-a3b8-f11f1f55a395 for instance 649b4ff1-abbd-4ccb-8b5a-9ba24f560372 on hv-cinder-79819 Aug 24 19:30:47.196182 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-295919be-af5c-46a7-84e4-dc11ff7b1146 req-ca3b77b3-fafc-4232-897a-826c401832b6 service nova] Creating event network-vif-plugged:f5cceb43-bd57-4a70-b5d7-600c3c4c3870 for instance ba289862-3027-492b-b4d1-d8539e4f3126 on hv-cinder-79819 Aug 24 19:30:47.208401 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-295919be-af5c-46a7-84e4-dc11ff7b1146 req-ca3b77b3-fafc-4232-897a-826c401832b6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.048602 Aug 24 19:30:47.212456 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 66/147] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:30:47 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:47.216874 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1f1d7ed0-b2b3-435d-b516-cc25331694e9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:47.217611 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1f1d7ed0-b2b3-435d-b516-cc25331694e9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:47.229956 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1f1d7ed0-b2b3-435d-b516-cc25331694e9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:47.230398 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1f1d7ed0-b2b3-435d-b516-cc25331694e9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:47.231352 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1f1d7ed0-b2b3-435d-b516-cc25331694e9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:47.232017 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1f1d7ed0-b2b3-435d-b516-cc25331694e9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:47.241447 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a6fbfa36-28bd-41aa-a387-6ae2d2bff4e4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:47.250116 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a6fbfa36-28bd-41aa-a387-6ae2d2bff4e4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:47.251625 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a6fbfa36-28bd-41aa-a387-6ae2d2bff4e4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:47.252781 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a6fbfa36-28bd-41aa-a387-6ae2d2bff4e4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1406 microversion: 2.20 time: 0.170690 Aug 24 19:30:47.253352 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 82/148] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:47 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:47.417452 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1f1d7ed0-b2b3-435d-b516-cc25331694e9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:47.425726 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1f1d7ed0-b2b3-435d-b516-cc25331694e9 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 0.213802 Aug 24 19:30:47.426304 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 67/149] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:47 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:47.506811 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f4c7d899-133f-48b3-bbcf-d5dc763b3901 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:47.507417 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f4c7d899-133f-48b3-bbcf-d5dc763b3901 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:47.513398 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f4c7d899-133f-48b3-bbcf-d5dc763b3901 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:47.514079 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f4c7d899-133f-48b3-bbcf-d5dc763b3901 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:47.514857 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f4c7d899-133f-48b3-bbcf-d5dc763b3901 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:47.515286 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f4c7d899-133f-48b3-bbcf-d5dc763b3901 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:47.657249 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-32bad1c3-bf7f-4402-8a8f-8f8604f087d2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:47.658106 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-32bad1c3-bf7f-4402-8a8f-8f8604f087d2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:47.669019 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-32bad1c3-bf7f-4402-8a8f-8f8604f087d2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:47.670480 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-32bad1c3-bf7f-4402-8a8f-8f8604f087d2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:47.670986 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-32bad1c3-bf7f-4402-8a8f-8f8604f087d2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:47.671816 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-32bad1c3-bf7f-4402-8a8f-8f8604f087d2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:47.709882 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f4c7d899-133f-48b3-bbcf-d5dc763b3901 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:47.717886 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f4c7d899-133f-48b3-bbcf-d5dc763b3901 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1322 microversion: 2.1 time: 0.214677 Aug 24 19:30:47.729066 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 83/150] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:47 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:47.923054 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-af35be5d-14ac-41ed-a94e-061bd7ddb4e7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:47.923705 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-af35be5d-14ac-41ed-a94e-061bd7ddb4e7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:47.943506 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-af35be5d-14ac-41ed-a94e-061bd7ddb4e7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:47.943506 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-af35be5d-14ac-41ed-a94e-061bd7ddb4e7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:47.943506 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-af35be5d-14ac-41ed-a94e-061bd7ddb4e7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:47.943806 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-af35be5d-14ac-41ed-a94e-061bd7ddb4e7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:47.977240 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-32bad1c3-bf7f-4402-8a8f-8f8604f087d2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:47.984905 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-32bad1c3-bf7f-4402-8a8f-8f8604f087d2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 0.334307 Aug 24 19:30:47.985571 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 68/151] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:47 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:48.134390 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-af35be5d-14ac-41ed-a94e-061bd7ddb4e7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:48.141752 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-af35be5d-14ac-41ed-a94e-061bd7ddb4e7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1362 microversion: 2.1 time: 0.223295 Aug 24 19:30:48.142317 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 84/152] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:47 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:48.273003 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-285736d2-911b-43ee-8865-d0dee7df8a54 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:48.274018 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-285736d2-911b-43ee-8865-d0dee7df8a54 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:48.280815 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-285736d2-911b-43ee-8865-d0dee7df8a54 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:48.281257 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-285736d2-911b-43ee-8865-d0dee7df8a54 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:48.282043 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-285736d2-911b-43ee-8865-d0dee7df8a54 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:48.282476 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-285736d2-911b-43ee-8865-d0dee7df8a54 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:48.443230 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-87230068-8794-470c-8289-14030cdf0353 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:48.444097 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-87230068-8794-470c-8289-14030cdf0353 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:48.450112 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-87230068-8794-470c-8289-14030cdf0353 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:48.450567 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-87230068-8794-470c-8289-14030cdf0353 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:48.451326 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-87230068-8794-470c-8289-14030cdf0353 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:48.451748 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-87230068-8794-470c-8289-14030cdf0353 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:48.657685 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-87230068-8794-470c-8289-14030cdf0353 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:48.661252 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-285736d2-911b-43ee-8865-d0dee7df8a54 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:48.670394 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-285736d2-911b-43ee-8865-d0dee7df8a54 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:48.671547 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-87230068-8794-470c-8289-14030cdf0353 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 0.231742 Aug 24 19:30:48.672420 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-285736d2-911b-43ee-8865-d0dee7df8a54 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:48.673865 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-285736d2-911b-43ee-8865-d0dee7df8a54 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1406 microversion: 2.20 time: 0.404888 Aug 24 19:30:48.674534 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 69/153] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:48 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:48.682291 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 85/154] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:48 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:48.745360 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5d38e3ae-4630-47a2-812b-871e9a566430 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:48.746123 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5d38e3ae-4630-47a2-812b-871e9a566430 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:48.752483 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5d38e3ae-4630-47a2-812b-871e9a566430 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:48.752924 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5d38e3ae-4630-47a2-812b-871e9a566430 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:48.753686 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5d38e3ae-4630-47a2-812b-871e9a566430 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:48.754275 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5d38e3ae-4630-47a2-812b-871e9a566430 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:48.892042 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5d38e3ae-4630-47a2-812b-871e9a566430 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:48.900961 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5d38e3ae-4630-47a2-812b-871e9a566430 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1515 microversion: 2.1 time: 0.159194 Aug 24 19:30:48.908320 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 70/155] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:48 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:48.924511 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6df16b1c-43a4-4b2e-bda0-6d8269147186 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:48.925809 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6df16b1c-43a4-4b2e-bda0-6d8269147186 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:48.932126 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6df16b1c-43a4-4b2e-bda0-6d8269147186 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:48.932633 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6df16b1c-43a4-4b2e-bda0-6d8269147186 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:48.933413 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6df16b1c-43a4-4b2e-bda0-6d8269147186 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:48.933831 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6df16b1c-43a4-4b2e-bda0-6d8269147186 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:49.002545 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-056fc2ea-87e3-42ee-beaa-0e4e5e36b417 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:49.003627 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.objects.instance [None req-6df16b1c-43a4-4b2e-bda0-6d8269147186 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lazy-loading 'flavor' on Instance uuid 0b3252f0-c442-46e2-9da6-666aacad067c {{(pid=108908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:30:49.004035 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-056fc2ea-87e3-42ee-beaa-0e4e5e36b417 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:49.013212 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-056fc2ea-87e3-42ee-beaa-0e4e5e36b417 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:49.013666 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-056fc2ea-87e3-42ee-beaa-0e4e5e36b417 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:49.014543 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-056fc2ea-87e3-42ee-beaa-0e4e5e36b417 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:49.015473 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-056fc2ea-87e3-42ee-beaa-0e4e5e36b417 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:49.203746 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-056fc2ea-87e3-42ee-beaa-0e4e5e36b417 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:49.218415 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-056fc2ea-87e3-42ee-beaa-0e4e5e36b417 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1317 microversion: 2.1 time: 0.219859 Aug 24 19:30:49.219314 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 71/156] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:48 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:49.233311 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9c6a0300-4c00-4dab-9553-7e4aaf0fc3cc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:49.235163 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9c6a0300-4c00-4dab-9553-7e4aaf0fc3cc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:49.242214 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9c6a0300-4c00-4dab-9553-7e4aaf0fc3cc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:49.242752 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9c6a0300-4c00-4dab-9553-7e4aaf0fc3cc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:49.243539 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9c6a0300-4c00-4dab-9553-7e4aaf0fc3cc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:49.244092 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9c6a0300-4c00-4dab-9553-7e4aaf0fc3cc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:49.408747 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9c6a0300-4c00-4dab-9553-7e4aaf0fc3cc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:49.428870 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9c6a0300-4c00-4dab-9553-7e4aaf0fc3cc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1362 microversion: 2.1 time: 0.205867 Aug 24 19:30:49.440227 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 72/157] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:49 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:49.446917 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-5d296dbe-910e-4e30-9459-09cb91df867e req-2560eac5-3622-4523-acf4-b9cdc83e8181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01", "name": "network-vif-plugged", "status": "completed", "tag": "adfe6c55-fc59-4263-be71-0135828820e8"}, {"server_uuid": "7c70c776-ec7a-4970-9d9f-baf8c6568257", "name": "network-vif-plugged", "status": "completed", "tag": "39906ad8-eb91-4f23-8e1c-cbdd3d7aa570"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:49.450958 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:30:49.450958 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:30:49.451850 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6df16b1c-43a4-4b2e-bda0-6d8269147186 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "POST /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c/action" status: 200 len: 32 microversion: 2.1 time: 0.531349 Aug 24 19:30:49.458061 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 86/158] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:30:48 2021] POST /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c/action => generated 32 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:30:49.458213 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-5d296dbe-910e-4e30-9459-09cb91df867e req-2560eac5-3622-4523-acf4-b9cdc83e8181 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:49.458213 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-5d296dbe-910e-4e30-9459-09cb91df867e req-2560eac5-3622-4523-acf4-b9cdc83e8181 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:49.475061 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-5d296dbe-910e-4e30-9459-09cb91df867e req-2560eac5-3622-4523-acf4-b9cdc83e8181 service nova] Creating event network-vif-plugged:adfe6c55-fc59-4263-be71-0135828820e8 for instance a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 on hv-cinder-79819 Aug 24 19:30:49.479808 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-5d296dbe-910e-4e30-9459-09cb91df867e req-2560eac5-3622-4523-acf4-b9cdc83e8181 service nova] Creating event network-vif-plugged:39906ad8-eb91-4f23-8e1c-cbdd3d7aa570 for instance 7c70c776-ec7a-4970-9d9f-baf8c6568257 on hv-cinder-79819 Aug 24 19:30:49.479923 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c6876a00-ce89-4e97-b23a-f90d5fe6d086 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:49.479923 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-c6876a00-ce89-4e97-b23a-f90d5fe6d086 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:49.485325 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-5d296dbe-910e-4e30-9459-09cb91df867e req-2560eac5-3622-4523-acf4-b9cdc83e8181 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042421 Aug 24 19:30:49.485932 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 73/159] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:30:49 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:49.487407 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c6876a00-ce89-4e97-b23a-f90d5fe6d086 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:49.488071 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c6876a00-ce89-4e97-b23a-f90d5fe6d086 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:49.489891 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c6876a00-ce89-4e97-b23a-f90d5fe6d086 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:49.491145 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c6876a00-ce89-4e97-b23a-f90d5fe6d086 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:49.689470 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6f3e5397-e8d0-4f10-be77-5b9b802cb863 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:49.690153 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6f3e5397-e8d0-4f10-be77-5b9b802cb863 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:49.696139 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6f3e5397-e8d0-4f10-be77-5b9b802cb863 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:49.696608 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6f3e5397-e8d0-4f10-be77-5b9b802cb863 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:49.697393 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6f3e5397-e8d0-4f10-be77-5b9b802cb863 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:49.697894 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6f3e5397-e8d0-4f10-be77-5b9b802cb863 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:49.699079 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-c6876a00-ce89-4e97-b23a-f90d5fe6d086 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:49.709479 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c6876a00-ce89-4e97-b23a-f90d5fe6d086 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.239745 Aug 24 19:30:49.710619 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 87/160] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:49 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:49.716512 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b3c0948a-bb11-489e-95a3-cab5b9aaaecd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:49.717543 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b3c0948a-bb11-489e-95a3-cab5b9aaaecd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:49.724203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b3c0948a-bb11-489e-95a3-cab5b9aaaecd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:49.726416 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b3c0948a-bb11-489e-95a3-cab5b9aaaecd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:49.728245 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b3c0948a-bb11-489e-95a3-cab5b9aaaecd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:49.728924 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b3c0948a-bb11-489e-95a3-cab5b9aaaecd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:50.082394 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b3c0948a-bb11-489e-95a3-cab5b9aaaecd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:50.096317 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b3c0948a-bb11-489e-95a3-cab5b9aaaecd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:50.098628 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b3c0948a-bb11-489e-95a3-cab5b9aaaecd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:50.099459 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b3c0948a-bb11-489e-95a3-cab5b9aaaecd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1406 microversion: 2.20 time: 0.387570 Aug 24 19:30:50.105281 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6f3e5397-e8d0-4f10-be77-5b9b802cb863 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:50.109915 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 88/161] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:49 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1406 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:50.112723 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6f3e5397-e8d0-4f10-be77-5b9b802cb863 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1315 microversion: 2.1 time: 0.427329 Aug 24 19:30:50.113304 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 74/162] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:49 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:50.234717 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1c4f6c54-eedd-4f41-9459-70012e866d4a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:50.235351 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1c4f6c54-eedd-4f41-9459-70012e866d4a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:50.241468 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c4f6c54-eedd-4f41-9459-70012e866d4a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:50.241913 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c4f6c54-eedd-4f41-9459-70012e866d4a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:50.242705 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c4f6c54-eedd-4f41-9459-70012e866d4a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:50.247205 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c4f6c54-eedd-4f41-9459-70012e866d4a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:50.378351 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1c4f6c54-eedd-4f41-9459-70012e866d4a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:50.386658 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1c4f6c54-eedd-4f41-9459-70012e866d4a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1507 microversion: 2.1 time: 0.155511 Aug 24 19:30:50.387243 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 89/163] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:50 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:50.447438 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-2de30b20-99d6-47a7-9e10-204f1ae4e294 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:50.448026 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-2de30b20-99d6-47a7-9e10-204f1ae4e294 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:50.453925 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2de30b20-99d6-47a7-9e10-204f1ae4e294 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:50.454333 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2de30b20-99d6-47a7-9e10-204f1ae4e294 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:50.455073 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2de30b20-99d6-47a7-9e10-204f1ae4e294 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:50.455515 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2de30b20-99d6-47a7-9e10-204f1ae4e294 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:50.605064 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2de30b20-99d6-47a7-9e10-204f1ae4e294 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:50.612953 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-2de30b20-99d6-47a7-9e10-204f1ae4e294 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1362 microversion: 2.1 time: 0.169105 Aug 24 19:30:50.613552 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 75/164] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:50 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:50.727195 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-150c6ee5-8042-4267-b1a5-f8cf7b9b7b29 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:50.727723 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-150c6ee5-8042-4267-b1a5-f8cf7b9b7b29 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:50.734600 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-150c6ee5-8042-4267-b1a5-f8cf7b9b7b29 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:50.735234 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-150c6ee5-8042-4267-b1a5-f8cf7b9b7b29 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:50.736186 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-150c6ee5-8042-4267-b1a5-f8cf7b9b7b29 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:50.736790 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-150c6ee5-8042-4267-b1a5-f8cf7b9b7b29 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:50.877295 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-150c6ee5-8042-4267-b1a5-f8cf7b9b7b29 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:50.884505 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-150c6ee5-8042-4267-b1a5-f8cf7b9b7b29 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.161094 Aug 24 19:30:50.885093 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 90/165] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:50 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:51.117266 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-43e8b3cb-fa61-4bad-98cd-46863452b1a9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:51.117871 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-43e8b3cb-fa61-4bad-98cd-46863452b1a9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:51.124002 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-43e8b3cb-fa61-4bad-98cd-46863452b1a9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:51.124746 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-43e8b3cb-fa61-4bad-98cd-46863452b1a9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:51.125679 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-43e8b3cb-fa61-4bad-98cd-46863452b1a9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:51.126331 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-43e8b3cb-fa61-4bad-98cd-46863452b1a9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:51.129217 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-78beeab2-9b05-4432-9df1-a49cca37b7eb tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:51.129825 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-78beeab2-9b05-4432-9df1-a49cca37b7eb tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:51.138189 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-78beeab2-9b05-4432-9df1-a49cca37b7eb tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:51.138647 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-78beeab2-9b05-4432-9df1-a49cca37b7eb tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:51.139410 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-78beeab2-9b05-4432-9df1-a49cca37b7eb tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:51.139844 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-78beeab2-9b05-4432-9df1-a49cca37b7eb tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:51.407233 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-43e8b3cb-fa61-4bad-98cd-46863452b1a9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:51.415387 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-43e8b3cb-fa61-4bad-98cd-46863452b1a9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:51.416984 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-43e8b3cb-fa61-4bad-98cd-46863452b1a9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:51.418101 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-43e8b3cb-fa61-4bad-98cd-46863452b1a9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1406 microversion: 2.20 time: 0.304775 Aug 24 19:30:51.418667 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 76/166] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:51 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:30:51.458199 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-78beeab2-9b05-4432-9df1-a49cca37b7eb tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:51.460580 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-78beeab2-9b05-4432-9df1-a49cca37b7eb tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1502 microversion: 2.1 time: 0.334803 Aug 24 19:30:51.461259 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 91/167] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:51 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1502 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:51.629955 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-caee6f02-ac23-4fb6-97dd-de8381edae7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:51.630558 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-caee6f02-ac23-4fb6-97dd-de8381edae7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:51.636430 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-caee6f02-ac23-4fb6-97dd-de8381edae7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:51.637415 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-caee6f02-ac23-4fb6-97dd-de8381edae7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:51.638169 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-caee6f02-ac23-4fb6-97dd-de8381edae7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:51.638598 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-caee6f02-ac23-4fb6-97dd-de8381edae7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:51.823573 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-caee6f02-ac23-4fb6-97dd-de8381edae7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:51.831401 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-caee6f02-ac23-4fb6-97dd-de8381edae7b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1362 microversion: 2.1 time: 0.205131 Aug 24 19:30:51.831975 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 77/168] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:51 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:51.902802 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1e672110-3e25-4667-8fce-7a42556d83f0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:51.904305 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1e672110-3e25-4667-8fce-7a42556d83f0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:51.911576 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1e672110-3e25-4667-8fce-7a42556d83f0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:51.912591 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1e672110-3e25-4667-8fce-7a42556d83f0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:51.913514 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1e672110-3e25-4667-8fce-7a42556d83f0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:51.914088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1e672110-3e25-4667-8fce-7a42556d83f0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:52.126767 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1e672110-3e25-4667-8fce-7a42556d83f0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:52.126767 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1e672110-3e25-4667-8fce-7a42556d83f0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.161628 Aug 24 19:30:52.126767 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 92/169] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:51 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:52.435889 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-951c2fdd-14b3-4839-84a1-a49a8d38a4ea tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:52.436577 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-951c2fdd-14b3-4839-84a1-a49a8d38a4ea tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:52.442832 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-951c2fdd-14b3-4839-84a1-a49a8d38a4ea tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:52.443266 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-951c2fdd-14b3-4839-84a1-a49a8d38a4ea tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:52.444176 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-951c2fdd-14b3-4839-84a1-a49a8d38a4ea tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:52.444580 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-951c2fdd-14b3-4839-84a1-a49a8d38a4ea tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:52.567606 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-951c2fdd-14b3-4839-84a1-a49a8d38a4ea tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:52.575968 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-951c2fdd-14b3-4839-84a1-a49a8d38a4ea tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:52.577468 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-951c2fdd-14b3-4839-84a1-a49a8d38a4ea tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:52.578573 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-951c2fdd-14b3-4839-84a1-a49a8d38a4ea tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1598 microversion: 2.20 time: 0.146364 Aug 24 19:30:52.579162 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 78/170] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:30:52 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1598 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:30:52.600167 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-cc570377-b0b6-4538-874c-fcf1f080bb79 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:52.600676 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-cc570377-b0b6-4538-874c-fcf1f080bb79 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:52.606545 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cc570377-b0b6-4538-874c-fcf1f080bb79 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:52.606982 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cc570377-b0b6-4538-874c-fcf1f080bb79 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:52.607733 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cc570377-b0b6-4538-874c-fcf1f080bb79 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:52.608247 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cc570377-b0b6-4538-874c-fcf1f080bb79 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:52.694426 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-cc570377-b0b6-4538-874c-fcf1f080bb79 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098007 Aug 24 19:30:52.695017 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 93/171] 10.222.0.59 () {60 vars in 1316 bytes} [Tue Aug 24 19:30:52 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:30:52.722286 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-629cfae1-86cb-4347-90b3-539330e2a6c0 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8e4cf5a-22e0-4aea-bab4-4dd678400cba"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:52.723661 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-629cfae1-86cb-4347-90b3-539330e2a6c0 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:52.730323 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-629cfae1-86cb-4347-90b3-539330e2a6c0 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:52.732167 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-629cfae1-86cb-4347-90b3-539330e2a6c0 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:52.732167 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-629cfae1-86cb-4347-90b3-539330e2a6c0 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:52.732167 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-629cfae1-86cb-4347-90b3-539330e2a6c0 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:52.848365 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-cec37b62-7ddb-4df0-b456-d402bbcbf989 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:52.849168 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-cec37b62-7ddb-4df0-b456-d402bbcbf989 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:52.856588 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cec37b62-7ddb-4df0-b456-d402bbcbf989 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:52.857283 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cec37b62-7ddb-4df0-b456-d402bbcbf989 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:52.858476 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cec37b62-7ddb-4df0-b456-d402bbcbf989 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:52.859107 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cec37b62-7ddb-4df0-b456-d402bbcbf989 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:53.099523 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-cec37b62-7ddb-4df0-b456-d402bbcbf989 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:53.107000 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-cec37b62-7ddb-4df0-b456-d402bbcbf989 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1547 microversion: 2.1 time: 0.262710 Aug 24 19:30:53.107584 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 94/172] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:52 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1547 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:53.124403 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f668ef0c-9473-4629-b77a-0aac922543e4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:53.124898 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f668ef0c-9473-4629-b77a-0aac922543e4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:53.131154 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f668ef0c-9473-4629-b77a-0aac922543e4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:53.131600 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f668ef0c-9473-4629-b77a-0aac922543e4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:53.132407 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f668ef0c-9473-4629-b77a-0aac922543e4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:53.132836 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f668ef0c-9473-4629-b77a-0aac922543e4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:53.550887 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f668ef0c-9473-4629-b77a-0aac922543e4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.430884 Aug 24 19:30:53.562084 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 95/173] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 24 19:30:53 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/os-interface => generated 284 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:30:53.562084 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-706903ef-a717-41d5-8ae4-73faca6ea48c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:53.562084 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-706903ef-a717-41d5-8ae4-73faca6ea48c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:53.584436 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-706903ef-a717-41d5-8ae4-73faca6ea48c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:53.584887 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-706903ef-a717-41d5-8ae4-73faca6ea48c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:53.585744 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-706903ef-a717-41d5-8ae4-73faca6ea48c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:53.586112 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-706903ef-a717-41d5-8ae4-73faca6ea48c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:53.800620 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-706903ef-a717-41d5-8ae4-73faca6ea48c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:53.808106 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-706903ef-a717-41d5-8ae4-73faca6ea48c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.255604 Aug 24 19:30:53.808965 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 96/174] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:53 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:54.338485 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ab6ced4d-695d-4597-bd38-291f07de7027 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:54.339568 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ab6ced4d-695d-4597-bd38-291f07de7027 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:54.346057 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ab6ced4d-695d-4597-bd38-291f07de7027 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:54.351722 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ab6ced4d-695d-4597-bd38-291f07de7027 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:54.351722 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ab6ced4d-695d-4597-bd38-291f07de7027 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:54.351722 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ab6ced4d-695d-4597-bd38-291f07de7027 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:55.374282 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ab6ced4d-695d-4597-bd38-291f07de7027 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 14 microversion: 2.20 time: 1.039296 Aug 24 19:30:55.375982 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 97/175] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:30:54 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 14 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:55.383874 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-35442dfd-5681-497d-bb67-52233bb47d6a req-3997cdd4-1972-49ac-9522-295731f2a2ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c70c776-ec7a-4970-9d9f-baf8c6568257", "tag": "39906ad8-eb91-4f23-8e1c-cbdd3d7aa570"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:55.385992 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:30:55.385992 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:30:55.397517 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-35442dfd-5681-497d-bb67-52233bb47d6a req-3997cdd4-1972-49ac-9522-295731f2a2ed service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:55.398211 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-35442dfd-5681-497d-bb67-52233bb47d6a req-3997cdd4-1972-49ac-9522-295731f2a2ed service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:55.411460 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-35442dfd-5681-497d-bb67-52233bb47d6a req-3997cdd4-1972-49ac-9522-295731f2a2ed service nova] Creating event network-changed:39906ad8-eb91-4f23-8e1c-cbdd3d7aa570 for instance 7c70c776-ec7a-4970-9d9f-baf8c6568257 on hv-cinder-79819 Aug 24 19:30:55.416618 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-35442dfd-5681-497d-bb67-52233bb47d6a req-3997cdd4-1972-49ac-9522-295731f2a2ed service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039043 Aug 24 19:30:55.417578 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 98/176] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:30:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:55.424733 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6ae07851-8b88-4e86-bba6-fb62094f5bd4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:55.425619 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6ae07851-8b88-4e86-bba6-fb62094f5bd4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:55.432172 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6ae07851-8b88-4e86-bba6-fb62094f5bd4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:55.432653 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6ae07851-8b88-4e86-bba6-fb62094f5bd4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:55.433707 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6ae07851-8b88-4e86-bba6-fb62094f5bd4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:55.434308 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6ae07851-8b88-4e86-bba6-fb62094f5bd4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:55.630113 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6ae07851-8b88-4e86-bba6-fb62094f5bd4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:55.638782 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6ae07851-8b88-4e86-bba6-fb62094f5bd4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.219067 Aug 24 19:30:55.645440 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 99/177] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:55 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:55.645440 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e2b98477-c413-4666-9c6f-6a1c3eabe0eb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:55.645440 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e2b98477-c413-4666-9c6f-6a1c3eabe0eb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:55.652665 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e2b98477-c413-4666-9c6f-6a1c3eabe0eb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:55.653111 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e2b98477-c413-4666-9c6f-6a1c3eabe0eb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:55.654056 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e2b98477-c413-4666-9c6f-6a1c3eabe0eb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:55.654561 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e2b98477-c413-4666-9c6f-6a1c3eabe0eb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:55.760997 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e2b98477-c413-4666-9c6f-6a1c3eabe0eb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 14 microversion: 2.1 time: 0.120118 Aug 24 19:30:55.762781 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 100/178] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:30:55 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:30:55.769276 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-e907e03b-06ef-435f-a934-36be149baf4d req-322fafa3-6bc5-4531-a4cb-fdf1f229ba50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01", "tag": "adfe6c55-fc59-4263-be71-0135828820e8"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:55.773496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:30:55.773496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:30:55.787041 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-e907e03b-06ef-435f-a934-36be149baf4d req-322fafa3-6bc5-4531-a4cb-fdf1f229ba50 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:55.787424 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-e907e03b-06ef-435f-a934-36be149baf4d req-322fafa3-6bc5-4531-a4cb-fdf1f229ba50 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:55.803865 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-e907e03b-06ef-435f-a934-36be149baf4d req-322fafa3-6bc5-4531-a4cb-fdf1f229ba50 service nova] Creating event network-changed:adfe6c55-fc59-4263-be71-0135828820e8 for instance a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 on hv-cinder-79819 Aug 24 19:30:55.810050 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-e907e03b-06ef-435f-a934-36be149baf4d req-322fafa3-6bc5-4531-a4cb-fdf1f229ba50 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045765 Aug 24 19:30:55.811530 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 101/179] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:30:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:56.009682 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-629cfae1-86cb-4347-90b3-539330e2a6c0 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "POST /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.291116 Aug 24 19:30:56.013209 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 79/180] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 24 19:30:52 2021] POST /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b/os-volume_attachments => generated 194 bytes in 3293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:56.192545 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5be58fae-dfc6-4d72-bb60-6ff70100704b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72a21446-0a71-446b-aa91-684f84b6553d"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:56.193699 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5be58fae-dfc6-4d72-bb60-6ff70100704b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:56.199807 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5be58fae-dfc6-4d72-bb60-6ff70100704b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:56.200252 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5be58fae-dfc6-4d72-bb60-6ff70100704b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:56.201050 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5be58fae-dfc6-4d72-bb60-6ff70100704b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:56.201476 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5be58fae-dfc6-4d72-bb60-6ff70100704b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:56.387881 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f9a70079-950e-42b3-a7c6-47614c6b4d94 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:56.388876 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f9a70079-950e-42b3-a7c6-47614c6b4d94 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:56.395872 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f9a70079-950e-42b3-a7c6-47614c6b4d94 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:56.396336 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f9a70079-950e-42b3-a7c6-47614c6b4d94 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:56.397640 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f9a70079-950e-42b3-a7c6-47614c6b4d94 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:56.398243 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f9a70079-950e-42b3-a7c6-47614c6b4d94 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:56.471794 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f9a70079-950e-42b3-a7c6-47614c6b4d94 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 14 microversion: 2.20 time: 0.088676 Aug 24 19:30:56.472488 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 80/181] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:30:56 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:56.655856 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9ae7428b-eac4-4126-96fd-a94a35513e47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:56.656591 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9ae7428b-eac4-4126-96fd-a94a35513e47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:56.663435 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9ae7428b-eac4-4126-96fd-a94a35513e47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:56.663931 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9ae7428b-eac4-4126-96fd-a94a35513e47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:56.664741 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9ae7428b-eac4-4126-96fd-a94a35513e47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:56.665175 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9ae7428b-eac4-4126-96fd-a94a35513e47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:57.045890 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9ae7428b-eac4-4126-96fd-a94a35513e47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:57.053936 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9ae7428b-eac4-4126-96fd-a94a35513e47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.402648 Aug 24 19:30:57.057700 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 81/182] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:56 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:30:57.060255 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e5eefcfb-8d1a-4696-8b0d-ff7dd3754305 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:57.061276 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e5eefcfb-8d1a-4696-8b0d-ff7dd3754305 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:57.067242 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5eefcfb-8d1a-4696-8b0d-ff7dd3754305 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:57.067694 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5eefcfb-8d1a-4696-8b0d-ff7dd3754305 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:57.068491 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5eefcfb-8d1a-4696-8b0d-ff7dd3754305 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:57.068963 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5eefcfb-8d1a-4696-8b0d-ff7dd3754305 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:57.130000 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e5eefcfb-8d1a-4696-8b0d-ff7dd3754305 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 14 microversion: 2.1 time: 0.073939 Aug 24 19:30:57.130628 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 82/183] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:30:57 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:30:57.140825 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5be58fae-dfc6-4d72-bb60-6ff70100704b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "POST /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.952054 Aug 24 19:30:57.141492 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 102/184] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 24 19:30:56 2021] POST /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126/os-volume_attachments => generated 194 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:30:57.484441 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5475a013-fd6c-43f7-ad97-316230a80c71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:57.485530 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5475a013-fd6c-43f7-ad97-316230a80c71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:57.491937 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5475a013-fd6c-43f7-ad97-316230a80c71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:57.492408 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5475a013-fd6c-43f7-ad97-316230a80c71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:57.493163 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5475a013-fd6c-43f7-ad97-316230a80c71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:57.493583 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5475a013-fd6c-43f7-ad97-316230a80c71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:57.557293 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5475a013-fd6c-43f7-ad97-316230a80c71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 14 microversion: 2.20 time: 0.077425 Aug 24 19:30:57.557968 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 83/185] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:30:57 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:58.074193 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-038cd7d0-6249-4740-896c-45a5ba834397 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:58.074894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-038cd7d0-6249-4740-896c-45a5ba834397 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:58.082204 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-038cd7d0-6249-4740-896c-45a5ba834397 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:58.082710 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-038cd7d0-6249-4740-896c-45a5ba834397 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:58.083494 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-038cd7d0-6249-4740-896c-45a5ba834397 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:58.083923 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-038cd7d0-6249-4740-896c-45a5ba834397 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:58.141795 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-74fc8e2a-5394-45f6-9c8e-2cf435e10caf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:58.145899 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-74fc8e2a-5394-45f6-9c8e-2cf435e10caf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:58.149524 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74fc8e2a-5394-45f6-9c8e-2cf435e10caf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:58.150047 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74fc8e2a-5394-45f6-9c8e-2cf435e10caf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:58.151134 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74fc8e2a-5394-45f6-9c8e-2cf435e10caf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:58.151403 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74fc8e2a-5394-45f6-9c8e-2cf435e10caf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:58.207998 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-038cd7d0-6249-4740-896c-45a5ba834397 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:58.215992 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-038cd7d0-6249-4740-896c-45a5ba834397 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.146411 Aug 24 19:30:58.216603 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 103/186] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:58 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:58.235788 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-74fc8e2a-5394-45f6-9c8e-2cf435e10caf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 14 microversion: 2.1 time: 0.097836 Aug 24 19:30:58.236462 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 84/187] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:30:58 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 19:30:58.568223 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-97443c5c-72ae-42e5-b9c4-415689594a1c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:58.569237 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-97443c5c-72ae-42e5-b9c4-415689594a1c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:58.576023 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-97443c5c-72ae-42e5-b9c4-415689594a1c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:58.576170 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-97443c5c-72ae-42e5-b9c4-415689594a1c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:58.576988 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-97443c5c-72ae-42e5-b9c4-415689594a1c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:58.577431 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-97443c5c-72ae-42e5-b9c4-415689594a1c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:58.671577 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-97443c5c-72ae-42e5-b9c4-415689594a1c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 14 microversion: 2.20 time: 0.107065 Aug 24 19:30:58.675314 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 104/188] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:30:58 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:59.233506 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-884f53bc-34d5-4189-b5b0-fec842fe03dd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:30:59.234234 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-884f53bc-34d5-4189-b5b0-fec842fe03dd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:59.240853 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-884f53bc-34d5-4189-b5b0-fec842fe03dd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:59.241292 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-884f53bc-34d5-4189-b5b0-fec842fe03dd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:59.242114 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-884f53bc-34d5-4189-b5b0-fec842fe03dd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:59.242725 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-884f53bc-34d5-4189-b5b0-fec842fe03dd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:59.248223 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5a2b5d7b-41bd-4834-8def-c9803f857976 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:59.249448 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5a2b5d7b-41bd-4834-8def-c9803f857976 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:59.257620 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5a2b5d7b-41bd-4834-8def-c9803f857976 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:59.258126 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5a2b5d7b-41bd-4834-8def-c9803f857976 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:59.258913 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5a2b5d7b-41bd-4834-8def-c9803f857976 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:59.259350 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5a2b5d7b-41bd-4834-8def-c9803f857976 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:59.328392 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5a2b5d7b-41bd-4834-8def-c9803f857976 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 14 microversion: 2.1 time: 0.083887 Aug 24 19:30:59.332831 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 105/189] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:30:59 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:30:59.424731 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-884f53bc-34d5-4189-b5b0-fec842fe03dd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:30:59.450527 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-884f53bc-34d5-4189-b5b0-fec842fe03dd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.205388 Aug 24 19:30:59.450527 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 85/190] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:30:59 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:30:59.685223 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-53435408-9595-44fc-b2e2-864a4b6ce2c8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:30:59.686409 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-53435408-9595-44fc-b2e2-864a4b6ce2c8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:30:59.697888 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-53435408-9595-44fc-b2e2-864a4b6ce2c8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:59.699159 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-53435408-9595-44fc-b2e2-864a4b6ce2c8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:59.702825 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-53435408-9595-44fc-b2e2-864a4b6ce2c8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:30:59.703449 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-53435408-9595-44fc-b2e2-864a4b6ce2c8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:30:59.775939 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-53435408-9595-44fc-b2e2-864a4b6ce2c8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 14 microversion: 2.20 time: 0.095413 Aug 24 19:30:59.776655 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 106/191] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:30:59 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:00.340013 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9d1e5189-6f2e-4d4a-bbd7-d2b46d36bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:00.340939 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9d1e5189-6f2e-4d4a-bbd7-d2b46d36bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:00.347032 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9d1e5189-6f2e-4d4a-bbd7-d2b46d36bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:00.347476 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9d1e5189-6f2e-4d4a-bbd7-d2b46d36bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:00.348233 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9d1e5189-6f2e-4d4a-bbd7-d2b46d36bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:00.348680 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9d1e5189-6f2e-4d4a-bbd7-d2b46d36bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:00.431873 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9d1e5189-6f2e-4d4a-bbd7-d2b46d36bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 14 microversion: 2.1 time: 0.095283 Aug 24 19:31:00.432581 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 86/192] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:00 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 19:31:00.458833 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4bfeaa31-5c27-4f18-a1a9-e6f2e96106be tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:00.459532 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4bfeaa31-5c27-4f18-a1a9-e6f2e96106be tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:00.476636 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4bfeaa31-5c27-4f18-a1a9-e6f2e96106be tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:00.476636 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4bfeaa31-5c27-4f18-a1a9-e6f2e96106be tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:00.485346 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4bfeaa31-5c27-4f18-a1a9-e6f2e96106be tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:00.485871 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4bfeaa31-5c27-4f18-a1a9-e6f2e96106be tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:00.733215 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4bfeaa31-5c27-4f18-a1a9-e6f2e96106be tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:00.740484 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4bfeaa31-5c27-4f18-a1a9-e6f2e96106be tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.286335 Aug 24 19:31:00.741427 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 107/193] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:00 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:00.786961 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-3e1e3467-cc0b-4bdb-8c54-54b69ae9ee38 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:00.787936 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3e1e3467-cc0b-4bdb-8c54-54b69ae9ee38 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:00.795123 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3e1e3467-cc0b-4bdb-8c54-54b69ae9ee38 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:00.795564 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3e1e3467-cc0b-4bdb-8c54-54b69ae9ee38 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:00.796556 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3e1e3467-cc0b-4bdb-8c54-54b69ae9ee38 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:00.797142 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3e1e3467-cc0b-4bdb-8c54-54b69ae9ee38 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:00.869920 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-3e1e3467-cc0b-4bdb-8c54-54b69ae9ee38 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 14 microversion: 2.20 time: 0.086782 Aug 24 19:31:00.870549 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 87/194] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:00 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:01.450507 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9bfa3a5b-5ca7-4ea0-bebe-c6ca0da41947 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:01.451667 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9bfa3a5b-5ca7-4ea0-bebe-c6ca0da41947 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:01.458604 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9bfa3a5b-5ca7-4ea0-bebe-c6ca0da41947 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:01.459065 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9bfa3a5b-5ca7-4ea0-bebe-c6ca0da41947 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:01.460460 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9bfa3a5b-5ca7-4ea0-bebe-c6ca0da41947 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:01.460670 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9bfa3a5b-5ca7-4ea0-bebe-c6ca0da41947 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:01.546771 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9bfa3a5b-5ca7-4ea0-bebe-c6ca0da41947 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 14 microversion: 2.1 time: 0.105029 Aug 24 19:31:01.547516 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 108/195] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:01 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:31:01.759064 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-13c31b6c-4fcc-4df2-b0bb-e2412b5f8353 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:01.759702 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-13c31b6c-4fcc-4df2-b0bb-e2412b5f8353 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:01.766410 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-13c31b6c-4fcc-4df2-b0bb-e2412b5f8353 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:01.766849 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-13c31b6c-4fcc-4df2-b0bb-e2412b5f8353 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:01.767608 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-13c31b6c-4fcc-4df2-b0bb-e2412b5f8353 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:01.768032 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-13c31b6c-4fcc-4df2-b0bb-e2412b5f8353 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:01.882220 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b903271a-3363-4c65-98c1-dc5642d00b9b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:01.883783 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b903271a-3363-4c65-98c1-dc5642d00b9b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:01.891063 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b903271a-3363-4c65-98c1-dc5642d00b9b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:01.891844 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b903271a-3363-4c65-98c1-dc5642d00b9b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:01.892812 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b903271a-3363-4c65-98c1-dc5642d00b9b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:01.893476 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b903271a-3363-4c65-98c1-dc5642d00b9b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:01.937634 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-13c31b6c-4fcc-4df2-b0bb-e2412b5f8353 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:01.954922 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-13c31b6c-4fcc-4df2-b0bb-e2412b5f8353 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.200253 Aug 24 19:31:01.955827 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 88/196] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:01 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:01.968289 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b903271a-3363-4c65-98c1-dc5642d00b9b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 14 microversion: 2.20 time: 0.090513 Aug 24 19:31:01.973625 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 109/197] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:01 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:02.563789 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-601fa501-370d-48a3-ae3d-27ed5c773fae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:02.565096 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-601fa501-370d-48a3-ae3d-27ed5c773fae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:02.571053 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-601fa501-370d-48a3-ae3d-27ed5c773fae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:02.572554 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-601fa501-370d-48a3-ae3d-27ed5c773fae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:02.574582 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-601fa501-370d-48a3-ae3d-27ed5c773fae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:02.575165 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-601fa501-370d-48a3-ae3d-27ed5c773fae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:02.656953 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-601fa501-370d-48a3-ae3d-27ed5c773fae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 14 microversion: 2.1 time: 0.097220 Aug 24 19:31:02.658670 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 89/198] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:02 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:31:02.972961 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-404c8410-41e7-4653-bc57-f1bc54e7d882 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:02.977110 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-404c8410-41e7-4653-bc57-f1bc54e7d882 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:02.980377 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-404c8410-41e7-4653-bc57-f1bc54e7d882 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:02.980819 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-404c8410-41e7-4653-bc57-f1bc54e7d882 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:02.981617 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-404c8410-41e7-4653-bc57-f1bc54e7d882 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:02.981766 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-638ca526-0488-48fa-8a32-743c3a6b5e8c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:02.982222 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-404c8410-41e7-4653-bc57-f1bc54e7d882 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:02.982818 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-638ca526-0488-48fa-8a32-743c3a6b5e8c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:02.989298 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-638ca526-0488-48fa-8a32-743c3a6b5e8c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:02.989797 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-638ca526-0488-48fa-8a32-743c3a6b5e8c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:02.990551 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-638ca526-0488-48fa-8a32-743c3a6b5e8c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:02.990973 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-638ca526-0488-48fa-8a32-743c3a6b5e8c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:03.061795 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-638ca526-0488-48fa-8a32-743c3a6b5e8c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 14 microversion: 2.20 time: 0.083180 Aug 24 19:31:03.066329 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 90/199] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:02 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:03.121909 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-404c8410-41e7-4653-bc57-f1bc54e7d882 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:03.132052 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-404c8410-41e7-4653-bc57-f1bc54e7d882 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.163012 Aug 24 19:31:03.133566 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 110/200] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:02 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:03.675826 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f227bac3-c400-432f-8de0-b7aef26b8a8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:03.677036 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f227bac3-c400-432f-8de0-b7aef26b8a8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:03.684501 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f227bac3-c400-432f-8de0-b7aef26b8a8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:03.684945 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f227bac3-c400-432f-8de0-b7aef26b8a8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:03.685715 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f227bac3-c400-432f-8de0-b7aef26b8a8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:03.686136 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f227bac3-c400-432f-8de0-b7aef26b8a8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:03.840175 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f227bac3-c400-432f-8de0-b7aef26b8a8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 14 microversion: 2.1 time: 0.168735 Aug 24 19:31:03.843312 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 91/201] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:03 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 14 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:31:04.072855 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f43644a4-f2b9-4986-bcd9-b3d4e89c2041 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:04.074456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f43644a4-f2b9-4986-bcd9-b3d4e89c2041 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:04.081153 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f43644a4-f2b9-4986-bcd9-b3d4e89c2041 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:04.081603 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f43644a4-f2b9-4986-bcd9-b3d4e89c2041 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:04.082381 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f43644a4-f2b9-4986-bcd9-b3d4e89c2041 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:04.082817 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f43644a4-f2b9-4986-bcd9-b3d4e89c2041 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:04.155771 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-afa8b3fb-eee5-41bd-b075-a6072355d4a3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:04.156569 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-afa8b3fb-eee5-41bd-b075-a6072355d4a3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:04.163478 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-afa8b3fb-eee5-41bd-b075-a6072355d4a3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:04.164148 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-afa8b3fb-eee5-41bd-b075-a6072355d4a3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:04.165035 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-afa8b3fb-eee5-41bd-b075-a6072355d4a3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:04.165556 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-afa8b3fb-eee5-41bd-b075-a6072355d4a3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:04.171568 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f43644a4-f2b9-4986-bcd9-b3d4e89c2041 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 14 microversion: 2.20 time: 0.102111 Aug 24 19:31:04.175743 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 111/202] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:04 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:04.304352 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-afa8b3fb-eee5-41bd-b075-a6072355d4a3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:04.312874 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-afa8b3fb-eee5-41bd-b075-a6072355d4a3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.165391 Aug 24 19:31:04.323371 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 92/203] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:04 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:04.851466 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f1e85040-dfad-46a2-83de-7972d1a76335 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:04.852489 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f1e85040-dfad-46a2-83de-7972d1a76335 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:04.859091 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f1e85040-dfad-46a2-83de-7972d1a76335 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:04.859523 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f1e85040-dfad-46a2-83de-7972d1a76335 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:04.860315 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f1e85040-dfad-46a2-83de-7972d1a76335 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:04.860752 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f1e85040-dfad-46a2-83de-7972d1a76335 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:04.932621 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f1e85040-dfad-46a2-83de-7972d1a76335 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 14 microversion: 2.1 time: 0.084821 Aug 24 19:31:04.933255 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 112/204] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:04 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:31:05.185415 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-16e171cd-e925-45f7-a558-bfd2d512f3df tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:05.186332 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-16e171cd-e925-45f7-a558-bfd2d512f3df tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:05.192594 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-16e171cd-e925-45f7-a558-bfd2d512f3df tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:05.193044 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-16e171cd-e925-45f7-a558-bfd2d512f3df tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:05.193814 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-16e171cd-e925-45f7-a558-bfd2d512f3df tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:05.194240 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-16e171cd-e925-45f7-a558-bfd2d512f3df tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:05.263068 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-16e171cd-e925-45f7-a558-bfd2d512f3df tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 14 microversion: 2.20 time: 0.081750 Aug 24 19:31:05.263763 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 93/205] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:05 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:05.334048 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f7b78dd1-4f64-46b5-93b2-71ce46b6b396 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:05.334753 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f7b78dd1-4f64-46b5-93b2-71ce46b6b396 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:05.341408 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f7b78dd1-4f64-46b5-93b2-71ce46b6b396 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:05.341852 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f7b78dd1-4f64-46b5-93b2-71ce46b6b396 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:05.342931 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f7b78dd1-4f64-46b5-93b2-71ce46b6b396 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:05.343364 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f7b78dd1-4f64-46b5-93b2-71ce46b6b396 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:05.486425 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f7b78dd1-4f64-46b5-93b2-71ce46b6b396 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:05.494425 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f7b78dd1-4f64-46b5-93b2-71ce46b6b396 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.164776 Aug 24 19:31:05.495700 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 113/206] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:05 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:05.943896 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-aee20199-6eeb-4c3f-b8e1-096c8739d22f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:05.944841 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-aee20199-6eeb-4c3f-b8e1-096c8739d22f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:05.951734 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-aee20199-6eeb-4c3f-b8e1-096c8739d22f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:05.952152 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-aee20199-6eeb-4c3f-b8e1-096c8739d22f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:05.952957 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-aee20199-6eeb-4c3f-b8e1-096c8739d22f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:05.953388 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-aee20199-6eeb-4c3f-b8e1-096c8739d22f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:06.034081 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-aee20199-6eeb-4c3f-b8e1-096c8739d22f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 14 microversion: 2.1 time: 0.094085 Aug 24 19:31:06.034983 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 94/207] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:05 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:31:06.271128 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2102637595", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "networks": [{"uuid": "6a1a130c-ef7c-4e9a-95ba-539471ebdef0"}]}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:06.274811 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-399cbe70-4ef2-4b09-9be0-ce58e97de20f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:06.276512 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-399cbe70-4ef2-4b09-9be0-ce58e97de20f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:06.283707 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-399cbe70-4ef2-4b09-9be0-ce58e97de20f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:06.284305 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-399cbe70-4ef2-4b09-9be0-ce58e97de20f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:06.285083 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-399cbe70-4ef2-4b09-9be0-ce58e97de20f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:06.285514 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-399cbe70-4ef2-4b09-9be0-ce58e97de20f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:06.324012 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.network.neutron [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] validate_networks() for [('6a1a130c-ef7c-4e9a-95ba-539471ebdef0', None, None, None, None, None)] {{(pid=108908) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:31:06.374112 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-399cbe70-4ef2-4b09-9be0-ce58e97de20f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 14 microversion: 2.20 time: 0.103598 Aug 24 19:31:06.375017 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 95/208] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:06 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:06.514641 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a83fa9fa-7857-4d23-9e8b-8131585087b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:06.519424 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a83fa9fa-7857-4d23-9e8b-8131585087b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:06.522289 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a83fa9fa-7857-4d23-9e8b-8131585087b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:06.522739 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a83fa9fa-7857-4d23-9e8b-8131585087b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:06.523515 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a83fa9fa-7857-4d23-9e8b-8131585087b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:06.523954 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a83fa9fa-7857-4d23-9e8b-8131585087b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:06.730787 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a83fa9fa-7857-4d23-9e8b-8131585087b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:06.739180 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a83fa9fa-7857-4d23-9e8b-8131585087b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.229266 Aug 24 19:31:06.741063 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 96/209] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:06 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:06.763886 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Flavor limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:31:06.764383 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Image limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:31:06.764785 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Flavor pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:31:06.765185 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Image pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:31:06.765587 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:31:06.775343 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:06.775788 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:06.777396 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:06.777396 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:06.796014 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Getting quotas for project 7a54174229cb4b11bc07726eece4a2af. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:31:06.800332 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Getting quotas for user 3c437fd9d3774ba58eb9b4726b7667b5 and project 7a54174229cb4b11bc07726eece4a2af. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:31:06.812545 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Going to run 1 instances... {{(pid=108908) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:31:06.814855 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:31:06.948089 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-efe8f9dd-0dbc-4f72-a2bf-267a414fb5b9 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680439 Aug 24 19:31:06.948903 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 114/210] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:31:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:31:06.958619 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a556d5b9-9dfd-4674-a3f0-0828fce98e8a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:06.959258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a556d5b9-9dfd-4674-a3f0-0828fce98e8a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:07.011609 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a556d5b9-9dfd-4674-a3f0-0828fce98e8a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:07.018091 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a556d5b9-9dfd-4674-a3f0-0828fce98e8a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1218 microversion: 2.1 time: 0.063075 Aug 24 19:31:07.018627 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 97/211] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:06 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:07.047038 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-89ce48fd-3985-453a-a7a2-1e353745bb2d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:07.048737 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-89ce48fd-3985-453a-a7a2-1e353745bb2d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:07.055209 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89ce48fd-3985-453a-a7a2-1e353745bb2d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:07.055662 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89ce48fd-3985-453a-a7a2-1e353745bb2d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:07.056473 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89ce48fd-3985-453a-a7a2-1e353745bb2d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:07.057507 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89ce48fd-3985-453a-a7a2-1e353745bb2d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:07.131199 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-89ce48fd-3985-453a-a7a2-1e353745bb2d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 14 microversion: 2.1 time: 0.088861 Aug 24 19:31:07.131843 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 115/212] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:07 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 19:31:07.385582 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-be0fc2bc-ef4f-4ca2-a6c9-20a97a9ffba7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:07.386708 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-be0fc2bc-ef4f-4ca2-a6c9-20a97a9ffba7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:07.392792 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-be0fc2bc-ef4f-4ca2-a6c9-20a97a9ffba7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:07.393426 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-be0fc2bc-ef4f-4ca2-a6c9-20a97a9ffba7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:07.394206 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-be0fc2bc-ef4f-4ca2-a6c9-20a97a9ffba7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:07.398553 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-be0fc2bc-ef4f-4ca2-a6c9-20a97a9ffba7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:07.478142 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-be0fc2bc-ef4f-4ca2-a6c9-20a97a9ffba7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 14 microversion: 2.20 time: 0.096333 Aug 24 19:31:07.478824 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 98/213] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:07 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:07.763772 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5106352d-a3e8-4006-a81a-f8bd6c873c3a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:07.764504 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5106352d-a3e8-4006-a81a-f8bd6c873c3a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:07.771242 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5106352d-a3e8-4006-a81a-f8bd6c873c3a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:07.771697 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5106352d-a3e8-4006-a81a-f8bd6c873c3a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:07.772509 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5106352d-a3e8-4006-a81a-f8bd6c873c3a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:07.772948 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5106352d-a3e8-4006-a81a-f8bd6c873c3a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:07.913664 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-5106352d-a3e8-4006-a81a-f8bd6c873c3a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:07.921475 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5106352d-a3e8-4006-a81a-f8bd6c873c3a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.162264 Aug 24 19:31:07.922318 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 116/214] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:07 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:08.035024 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-868da530-83e3-44a5-b3d6-0f74b6603c8a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:08.035751 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-868da530-83e3-44a5-b3d6-0f74b6603c8a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:08.042641 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-868da530-83e3-44a5-b3d6-0f74b6603c8a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:08.043106 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-868da530-83e3-44a5-b3d6-0f74b6603c8a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:08.043878 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-868da530-83e3-44a5-b3d6-0f74b6603c8a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:08.044333 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-868da530-83e3-44a5-b3d6-0f74b6603c8a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:08.107791 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-868da530-83e3-44a5-b3d6-0f74b6603c8a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:08.115544 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-868da530-83e3-44a5-b3d6-0f74b6603c8a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1222 microversion: 2.1 time: 0.084493 Aug 24 19:31:08.116120 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 99/215] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:08 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:08.142122 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-bbbef9dc-a1bf-4c36-b7c3-a55ec862f243 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:08.143040 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-bbbef9dc-a1bf-4c36-b7c3-a55ec862f243 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:08.148958 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bbbef9dc-a1bf-4c36-b7c3-a55ec862f243 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:08.152000 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bbbef9dc-a1bf-4c36-b7c3-a55ec862f243 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:08.152000 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bbbef9dc-a1bf-4c36-b7c3-a55ec862f243 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:08.152000 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bbbef9dc-a1bf-4c36-b7c3-a55ec862f243 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:08.236111 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-bbbef9dc-a1bf-4c36-b7c3-a55ec862f243 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 14 microversion: 2.1 time: 0.097625 Aug 24 19:31:08.236875 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 117/216] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:08 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:31:08.490070 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c1844803-e695-4626-a6d8-406b93564a81 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:08.490990 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c1844803-e695-4626-a6d8-406b93564a81 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:08.498020 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c1844803-e695-4626-a6d8-406b93564a81 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:08.498649 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c1844803-e695-4626-a6d8-406b93564a81 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:08.499317 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c1844803-e695-4626-a6d8-406b93564a81 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:08.499747 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c1844803-e695-4626-a6d8-406b93564a81 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:08.576083 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c1844803-e695-4626-a6d8-406b93564a81 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 14 microversion: 2.20 time: 0.089534 Aug 24 19:31:08.579502 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 100/217] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:08 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:08.938476 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ce65799f-df76-43d7-86f1-6b547222b94f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:08.939210 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ce65799f-df76-43d7-86f1-6b547222b94f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:08.946166 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ce65799f-df76-43d7-86f1-6b547222b94f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:08.946618 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ce65799f-df76-43d7-86f1-6b547222b94f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:08.947501 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ce65799f-df76-43d7-86f1-6b547222b94f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:08.947942 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ce65799f-df76-43d7-86f1-6b547222b94f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:09.084113 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ce65799f-df76-43d7-86f1-6b547222b94f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:09.092495 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ce65799f-df76-43d7-86f1-6b547222b94f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.158062 Aug 24 19:31:09.093081 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 118/218] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:08 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:09.132787 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9a747d5a-bceb-4154-8326-1bbe849e6841 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:09.133721 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9a747d5a-bceb-4154-8326-1bbe849e6841 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:09.140746 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9a747d5a-bceb-4154-8326-1bbe849e6841 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:09.141190 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9a747d5a-bceb-4154-8326-1bbe849e6841 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:09.142006 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9a747d5a-bceb-4154-8326-1bbe849e6841 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:09.142449 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9a747d5a-bceb-4154-8326-1bbe849e6841 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:09.230143 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9a747d5a-bceb-4154-8326-1bbe849e6841 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:09.237184 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9a747d5a-bceb-4154-8326-1bbe849e6841 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1278 microversion: 2.1 time: 0.108482 Aug 24 19:31:09.239899 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 101/219] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:09 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1278 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:09.260968 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-be61a123-794c-4721-bbe9-34b8930a6bc0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:09.262500 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-be61a123-794c-4721-bbe9-34b8930a6bc0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:09.274982 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-be61a123-794c-4721-bbe9-34b8930a6bc0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:09.280143 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-be61a123-794c-4721-bbe9-34b8930a6bc0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:09.281101 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-be61a123-794c-4721-bbe9-34b8930a6bc0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:09.290322 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-be61a123-794c-4721-bbe9-34b8930a6bc0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:09.417576 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-be61a123-794c-4721-bbe9-34b8930a6bc0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 6451 microversion: 2.1 time: 0.162362 Aug 24 19:31:09.422137 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 119/220] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:09 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 6451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:09.587306 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6ffceaaa-de66-421e-9956-dfecb98cc06e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:09.588874 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6ffceaaa-de66-421e-9956-dfecb98cc06e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:09.595909 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6ffceaaa-de66-421e-9956-dfecb98cc06e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:09.596679 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6ffceaaa-de66-421e-9956-dfecb98cc06e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:09.597599 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6ffceaaa-de66-421e-9956-dfecb98cc06e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:09.598028 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6ffceaaa-de66-421e-9956-dfecb98cc06e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:09.724570 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6ffceaaa-de66-421e-9956-dfecb98cc06e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 7599 microversion: 2.20 time: 0.140948 Aug 24 19:31:09.728428 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 102/221] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:09 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 7599 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:31:10.110430 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-79520ac2-37d0-49c2-af7c-3d67a15c5f9e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:10.116508 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-79520ac2-37d0-49c2-af7c-3d67a15c5f9e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:10.128830 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-79520ac2-37d0-49c2-af7c-3d67a15c5f9e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:10.130202 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-79520ac2-37d0-49c2-af7c-3d67a15c5f9e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:10.130989 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-79520ac2-37d0-49c2-af7c-3d67a15c5f9e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:10.131414 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-79520ac2-37d0-49c2-af7c-3d67a15c5f9e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:10.261193 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ea554361-0469-474f-b0da-64142c7e0f8d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:10.262640 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ea554361-0469-474f-b0da-64142c7e0f8d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:10.271451 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea554361-0469-474f-b0da-64142c7e0f8d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:10.271879 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea554361-0469-474f-b0da-64142c7e0f8d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:10.272790 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea554361-0469-474f-b0da-64142c7e0f8d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:10.273352 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea554361-0469-474f-b0da-64142c7e0f8d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:10.330300 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-79520ac2-37d0-49c2-af7c-3d67a15c5f9e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:10.338644 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-79520ac2-37d0-49c2-af7c-3d67a15c5f9e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.232090 Aug 24 19:31:10.339668 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 120/222] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:10 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:10.432373 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9ca61829-168f-43d8-bc9f-6542248b99c3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:10.433827 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9ca61829-168f-43d8-bc9f-6542248b99c3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:10.440492 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9ca61829-168f-43d8-bc9f-6542248b99c3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:10.441664 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9ca61829-168f-43d8-bc9f-6542248b99c3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:10.443023 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9ca61829-168f-43d8-bc9f-6542248b99c3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:10.443869 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9ca61829-168f-43d8-bc9f-6542248b99c3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:10.540301 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ea554361-0469-474f-b0da-64142c7e0f8d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:10.549764 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ea554361-0469-474f-b0da-64142c7e0f8d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1318 microversion: 2.1 time: 0.295566 Aug 24 19:31:10.550338 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 103/223] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:10 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:10.562806 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9ca61829-168f-43d8-bc9f-6542248b99c3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 11132 microversion: 2.1 time: 0.136575 Aug 24 19:31:10.563911 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 121/224] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:10 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 11132 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:10.735977 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-3f5a548d-0056-4890-a0c3-bb33ea3738a0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:10.736895 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3f5a548d-0056-4890-a0c3-bb33ea3738a0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:10.742650 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3f5a548d-0056-4890-a0c3-bb33ea3738a0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:10.743086 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3f5a548d-0056-4890-a0c3-bb33ea3738a0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:10.743864 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3f5a548d-0056-4890-a0c3-bb33ea3738a0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:10.744303 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3f5a548d-0056-4890-a0c3-bb33ea3738a0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:10.838571 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-3f5a548d-0056-4890-a0c3-bb33ea3738a0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 11454 microversion: 2.20 time: 0.106040 Aug 24 19:31:10.839857 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 104/225] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:10 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 11454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:11.188027 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-db5b3561-03e3-4b59-8332-28ac0facedbd req-d6a6a25f-cacf-417a-88b5-05613538a9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9dc0dd-298e-4b3f-8117-338c6322ecda", "tag": "882519cf-19ed-487a-b2db-37296318380e"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:11.189633 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:31:11.189633 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:31:11.208114 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-db5b3561-03e3-4b59-8332-28ac0facedbd req-d6a6a25f-cacf-417a-88b5-05613538a9c5 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:11.209429 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-db5b3561-03e3-4b59-8332-28ac0facedbd req-d6a6a25f-cacf-417a-88b5-05613538a9c5 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:11.228576 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-db5b3561-03e3-4b59-8332-28ac0facedbd req-d6a6a25f-cacf-417a-88b5-05613538a9c5 service nova] Creating event network-changed:882519cf-19ed-487a-b2db-37296318380e for instance 9f9dc0dd-298e-4b3f-8117-338c6322ecda on hv-cinder-79819 Aug 24 19:31:11.233474 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-db5b3561-03e3-4b59-8332-28ac0facedbd req-d6a6a25f-cacf-417a-88b5-05613538a9c5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049462 Aug 24 19:31:11.234076 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 122/226] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:31:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:31:11.367693 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4b97b9e4-824f-4542-bf59-df85d1e22225 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:11.369942 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4b97b9e4-824f-4542-bf59-df85d1e22225 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:11.389064 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b97b9e4-824f-4542-bf59-df85d1e22225 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:11.389615 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b97b9e4-824f-4542-bf59-df85d1e22225 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:11.390772 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b97b9e4-824f-4542-bf59-df85d1e22225 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:11.391280 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b97b9e4-824f-4542-bf59-df85d1e22225 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:11.567276 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-fd8bd5d9-af03-4bb2-a7b0-7eb1fc063153 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:11.567981 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-fd8bd5d9-af03-4bb2-a7b0-7eb1fc063153 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:11.574802 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fd8bd5d9-af03-4bb2-a7b0-7eb1fc063153 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:11.575249 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fd8bd5d9-af03-4bb2-a7b0-7eb1fc063153 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:11.576043 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fd8bd5d9-af03-4bb2-a7b0-7eb1fc063153 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:11.576491 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fd8bd5d9-af03-4bb2-a7b0-7eb1fc063153 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:11.720811 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4b97b9e4-824f-4542-bf59-df85d1e22225 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:11.730780 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4b97b9e4-824f-4542-bf59-df85d1e22225 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.378743 Aug 24 19:31:11.731463 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 105/227] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:11 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:11.736693 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-877928a9-eace-484b-be77-7787c082cc11 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:11.738551 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-877928a9-eace-484b-be77-7787c082cc11 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:11.754519 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-877928a9-eace-484b-be77-7787c082cc11 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:11.756768 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-877928a9-eace-484b-be77-7787c082cc11 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:11.757470 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-877928a9-eace-484b-be77-7787c082cc11 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:11.758152 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-877928a9-eace-484b-be77-7787c082cc11 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:11.877101 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-877928a9-eace-484b-be77-7787c082cc11 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 15025 microversion: 2.1 time: 0.140314 Aug 24 19:31:11.877101 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 106/228] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:11 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 15025 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:11.882057 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f4c92a93-c861-4edf-bdcf-3ff431d1a650 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:11.883207 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f4c92a93-c861-4edf-bdcf-3ff431d1a650 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:11.889780 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f4c92a93-c861-4edf-bdcf-3ff431d1a650 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:11.894424 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f4c92a93-c861-4edf-bdcf-3ff431d1a650 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:11.894424 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f4c92a93-c861-4edf-bdcf-3ff431d1a650 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:11.894424 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f4c92a93-c861-4edf-bdcf-3ff431d1a650 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:11.941618 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-fd8bd5d9-af03-4bb2-a7b0-7eb1fc063153 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:11.949192 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-fd8bd5d9-af03-4bb2-a7b0-7eb1fc063153 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1318 microversion: 2.1 time: 0.385983 Aug 24 19:31:11.949769 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 123/229] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:11 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:12.001127 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f4c92a93-c861-4edf-bdcf-3ff431d1a650 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 15064 microversion: 2.20 time: 0.124921 Aug 24 19:31:12.002088 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 107/230] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:11 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 15064 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:12.748110 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0cd6bace-c5c7-402f-a213-320c7d7b23b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:12.748733 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0cd6bace-c5c7-402f-a213-320c7d7b23b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:12.756794 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0cd6bace-c5c7-402f-a213-320c7d7b23b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:12.756794 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0cd6bace-c5c7-402f-a213-320c7d7b23b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:12.756794 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0cd6bace-c5c7-402f-a213-320c7d7b23b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:12.757121 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0cd6bace-c5c7-402f-a213-320c7d7b23b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:12.888432 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-97d70a6b-9f93-4529-ad62-a9458ef25bc4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:12.889790 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-97d70a6b-9f93-4529-ad62-a9458ef25bc4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:12.896222 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0cd6bace-c5c7-402f-a213-320c7d7b23b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:12.907925 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-97d70a6b-9f93-4529-ad62-a9458ef25bc4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:12.908413 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-97d70a6b-9f93-4529-ad62-a9458ef25bc4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:12.909228 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-97d70a6b-9f93-4529-ad62-a9458ef25bc4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:12.909658 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-97d70a6b-9f93-4529-ad62-a9458ef25bc4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:12.926452 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0cd6bace-c5c7-402f-a213-320c7d7b23b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.181963 Aug 24 19:31:12.927125 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 124/231] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:12 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:12.966675 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ce495eb4-8c78-444b-acbd-fd565b34cc26 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:12.967295 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ce495eb4-8c78-444b-acbd-fd565b34cc26 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:12.973424 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ce495eb4-8c78-444b-acbd-fd565b34cc26 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:12.973877 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ce495eb4-8c78-444b-acbd-fd565b34cc26 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:12.974656 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ce495eb4-8c78-444b-acbd-fd565b34cc26 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:12.975092 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ce495eb4-8c78-444b-acbd-fd565b34cc26 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:13.014694 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-97d70a6b-9f93-4529-ad62-a9458ef25bc4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 16877 microversion: 2.1 time: 0.132726 Aug 24 19:31:13.015336 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 108/232] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:12 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 16877 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:31:13.021380 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-188296b1-8fe4-458a-9e9b-eba60c3bc167 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:13.024115 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-188296b1-8fe4-458a-9e9b-eba60c3bc167 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:13.029599 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-188296b1-8fe4-458a-9e9b-eba60c3bc167 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:13.030052 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-188296b1-8fe4-458a-9e9b-eba60c3bc167 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:13.030889 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-188296b1-8fe4-458a-9e9b-eba60c3bc167 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:13.031326 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-188296b1-8fe4-458a-9e9b-eba60c3bc167 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:13.123339 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ce495eb4-8c78-444b-acbd-fd565b34cc26 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:13.128359 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-188296b1-8fe4-458a-9e9b-eba60c3bc167 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 17401 microversion: 2.20 time: 0.111125 Aug 24 19:31:13.132721 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 109/233] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:13 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 17401 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:13.145112 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ce495eb4-8c78-444b-acbd-fd565b34cc26 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1318 microversion: 2.1 time: 0.179155 Aug 24 19:31:13.145923 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 125/234] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:12 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:13.899343 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4ca8dd08-9960-475f-b57c-a6f0d0782c29 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:13.900282 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4ca8dd08-9960-475f-b57c-a6f0d0782c29 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:13.907454 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4ca8dd08-9960-475f-b57c-a6f0d0782c29 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:13.907970 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4ca8dd08-9960-475f-b57c-a6f0d0782c29 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:13.908997 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4ca8dd08-9960-475f-b57c-a6f0d0782c29 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:13.909514 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4ca8dd08-9960-475f-b57c-a6f0d0782c29 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:13.937230 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4ca8dd08-9960-475f-b57c-a6f0d0782c29 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Going to try to terminate instance {{(pid=108907) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:31:13.942675 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-47504044-f73f-4b4a-91e8-62d8b45f7fef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:13.943305 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-47504044-f73f-4b4a-91e8-62d8b45f7fef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:13.949702 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-47504044-f73f-4b4a-91e8-62d8b45f7fef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:13.950148 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-47504044-f73f-4b4a-91e8-62d8b45f7fef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:13.950910 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-47504044-f73f-4b4a-91e8-62d8b45f7fef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:13.951337 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-47504044-f73f-4b4a-91e8-62d8b45f7fef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:14.089723 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-47504044-f73f-4b4a-91e8-62d8b45f7fef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:14.097376 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-47504044-f73f-4b4a-91e8-62d8b45f7fef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.158322 Aug 24 19:31:14.097966 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 126/235] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:13 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:14.104039 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-7b00d94f-9f3e-4747-b201-85f5afd1f6b8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:14.104039 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-7b00d94f-9f3e-4747-b201-85f5afd1f6b8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:14.111646 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7b00d94f-9f3e-4747-b201-85f5afd1f6b8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:14.112100 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7b00d94f-9f3e-4747-b201-85f5afd1f6b8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:14.112907 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7b00d94f-9f3e-4747-b201-85f5afd1f6b8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:14.113337 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7b00d94f-9f3e-4747-b201-85f5afd1f6b8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:14.205682 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-7b00d94f-9f3e-4747-b201-85f5afd1f6b8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 17717 microversion: 2.1 time: 0.106457 Aug 24 19:31:14.206308 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 127/236] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:14 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 17717 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:14.218193 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-cedca0d4-0fa1-4217-8d25-43e59726aee3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:14.218193 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-cedca0d4-0fa1-4217-8d25-43e59726aee3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:14.219398 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cedca0d4-0fa1-4217-8d25-43e59726aee3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:14.219843 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cedca0d4-0fa1-4217-8d25-43e59726aee3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:14.220643 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cedca0d4-0fa1-4217-8d25-43e59726aee3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:14.221102 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cedca0d4-0fa1-4217-8d25-43e59726aee3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:14.222045 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4ca8dd08-9960-475f-b57c-a6f0d0782c29 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 204 len: 0 microversion: 2.1 time: 0.326393 Aug 24 19:31:14.225803 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 110/237] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:31:13 2021] DELETE /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:31:14.231646 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b3ccb526-33e0-4201-9552-a0caec9b2350 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:14.232387 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b3ccb526-33e0-4201-9552-a0caec9b2350 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:14.238252 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3ccb526-33e0-4201-9552-a0caec9b2350 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:14.238695 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3ccb526-33e0-4201-9552-a0caec9b2350 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:14.239464 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3ccb526-33e0-4201-9552-a0caec9b2350 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:14.239888 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3ccb526-33e0-4201-9552-a0caec9b2350 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:14.364516 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b3ccb526-33e0-4201-9552-a0caec9b2350 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:14.371873 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b3ccb526-33e0-4201-9552-a0caec9b2350 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1318 microversion: 2.1 time: 0.144635 Aug 24 19:31:14.372806 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 111/238] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:14 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:14.376922 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9e6929ae-59d1-4c37-96ab-a5c5af3ec42e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:14.377523 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9e6929ae-59d1-4c37-96ab-a5c5af3ec42e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:14.383384 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9e6929ae-59d1-4c37-96ab-a5c5af3ec42e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:14.384467 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9e6929ae-59d1-4c37-96ab-a5c5af3ec42e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:14.385321 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9e6929ae-59d1-4c37-96ab-a5c5af3ec42e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:14.385818 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9e6929ae-59d1-4c37-96ab-a5c5af3ec42e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:14.507934 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9e6929ae-59d1-4c37-96ab-a5c5af3ec42e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:14.516371 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9e6929ae-59d1-4c37-96ab-a5c5af3ec42e tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1554 microversion: 2.1 time: 0.142844 Aug 24 19:31:14.516924 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 112/239] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:14 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1554 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:15.114621 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0b60aea6-9977-498b-9308-e6746c74ce9c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:15.115322 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0b60aea6-9977-498b-9308-e6746c74ce9c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:15.121964 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b60aea6-9977-498b-9308-e6746c74ce9c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:15.122410 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b60aea6-9977-498b-9308-e6746c74ce9c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:15.123177 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b60aea6-9977-498b-9308-e6746c74ce9c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:15.123615 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b60aea6-9977-498b-9308-e6746c74ce9c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:15.247529 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0b60aea6-9977-498b-9308-e6746c74ce9c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:15.255696 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0b60aea6-9977-498b-9308-e6746c74ce9c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.144804 Aug 24 19:31:15.263350 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 113/240] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:15 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:15.263350 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8d5fe6d8-deb5-462f-acca-8c2f29cca65b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:15.263350 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8d5fe6d8-deb5-462f-acca-8c2f29cca65b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:15.268025 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d5fe6d8-deb5-462f-acca-8c2f29cca65b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:15.268520 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d5fe6d8-deb5-462f-acca-8c2f29cca65b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:15.270275 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d5fe6d8-deb5-462f-acca-8c2f29cca65b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:15.270275 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d5fe6d8-deb5-462f-acca-8c2f29cca65b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:17.261682 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-cedca0d4-0fa1-4217-8d25-43e59726aee3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 19342 microversion: 2.20 time: 3.053945 Aug 24 19:31:17.262405 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 128/241] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:14 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 19342 bytes in 3055 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:17.267345 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-96d4aa82-9bd7-43e1-bf34-55f7e0a63d1a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:17.268079 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-96d4aa82-9bd7-43e1-bf34-55f7e0a63d1a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:17.274691 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-96d4aa82-9bd7-43e1-bf34-55f7e0a63d1a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:17.275186 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-96d4aa82-9bd7-43e1-bf34-55f7e0a63d1a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:17.275947 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-96d4aa82-9bd7-43e1-bf34-55f7e0a63d1a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:17.276397 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-96d4aa82-9bd7-43e1-bf34-55f7e0a63d1a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:17.345067 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8d5fe6d8-deb5-462f-acca-8c2f29cca65b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 20675 microversion: 2.1 time: 2.087353 Aug 24 19:31:17.347347 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 114/242] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:15 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 20675 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:17.352672 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d0a16985-40d7-4d19-b6ad-12ba76cd617b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:17.353440 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d0a16985-40d7-4d19-b6ad-12ba76cd617b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:17.359825 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d0a16985-40d7-4d19-b6ad-12ba76cd617b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:17.360292 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d0a16985-40d7-4d19-b6ad-12ba76cd617b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:17.361105 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d0a16985-40d7-4d19-b6ad-12ba76cd617b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:17.361537 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d0a16985-40d7-4d19-b6ad-12ba76cd617b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:17.411107 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-96d4aa82-9bd7-43e1-bf34-55f7e0a63d1a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:17.418936 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-96d4aa82-9bd7-43e1-bf34-55f7e0a63d1a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1318 microversion: 2.1 time: 0.155338 Aug 24 19:31:17.419508 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 129/243] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:17 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:17.424456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8d867e8a-1068-42db-b691-66a709c60f81 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:17.425059 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8d867e8a-1068-42db-b691-66a709c60f81 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:17.432218 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8d867e8a-1068-42db-b691-66a709c60f81 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:17.432715 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8d867e8a-1068-42db-b691-66a709c60f81 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:17.438489 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8d867e8a-1068-42db-b691-66a709c60f81 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:17.438489 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8d867e8a-1068-42db-b691-66a709c60f81 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:17.524636 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-d0a16985-40d7-4d19-b6ad-12ba76cd617b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:17.533975 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d0a16985-40d7-4d19-b6ad-12ba76cd617b tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1554 microversion: 2.1 time: 0.185950 Aug 24 19:31:17.534561 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 115/244] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:17 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1554 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:17.583104 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8d867e8a-1068-42db-b691-66a709c60f81 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:17.590565 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8d867e8a-1068-42db-b691-66a709c60f81 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.170036 Aug 24 19:31:17.591137 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 130/245] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:17 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:18.284878 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-09d9c788-829e-4c27-8d1a-1733865ea60d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:18.286183 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-09d9c788-829e-4c27-8d1a-1733865ea60d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:18.294714 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-09d9c788-829e-4c27-8d1a-1733865ea60d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:18.295481 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-09d9c788-829e-4c27-8d1a-1733865ea60d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:18.296780 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-09d9c788-829e-4c27-8d1a-1733865ea60d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:18.297522 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-09d9c788-829e-4c27-8d1a-1733865ea60d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:18.357556 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-68c15b57-8743-4ddd-aecb-d53485c84c02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:18.358457 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-68c15b57-8743-4ddd-aecb-d53485c84c02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:18.366148 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-68c15b57-8743-4ddd-aecb-d53485c84c02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:18.366587 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-68c15b57-8743-4ddd-aecb-d53485c84c02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:18.367379 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-68c15b57-8743-4ddd-aecb-d53485c84c02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:18.367872 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-68c15b57-8743-4ddd-aecb-d53485c84c02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:18.398186 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-09d9c788-829e-4c27-8d1a-1733865ea60d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 21512 microversion: 2.20 time: 0.123403 Aug 24 19:31:18.399481 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 116/246] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:18 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 21512 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:18.437639 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5bb3cdc5-fb83-4139-bcad-7f31b62d326a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:18.438269 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5bb3cdc5-fb83-4139-bcad-7f31b62d326a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:18.445252 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5bb3cdc5-fb83-4139-bcad-7f31b62d326a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:18.445730 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5bb3cdc5-fb83-4139-bcad-7f31b62d326a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:18.446604 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5bb3cdc5-fb83-4139-bcad-7f31b62d326a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:18.447128 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5bb3cdc5-fb83-4139-bcad-7f31b62d326a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:18.466157 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-68c15b57-8743-4ddd-aecb-d53485c84c02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 21834 microversion: 2.1 time: 0.112107 Aug 24 19:31:18.466840 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 131/247] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:18 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 21834 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:31:18.551702 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4f912e8f-ac3d-46c6-baa8-2e47b66027f1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:18.552429 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4f912e8f-ac3d-46c6-baa8-2e47b66027f1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:18.561183 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f912e8f-ac3d-46c6-baa8-2e47b66027f1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:18.561183 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f912e8f-ac3d-46c6-baa8-2e47b66027f1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:18.561183 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f912e8f-ac3d-46c6-baa8-2e47b66027f1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:18.561183 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f912e8f-ac3d-46c6-baa8-2e47b66027f1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:18.575741 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5bb3cdc5-fb83-4139-bcad-7f31b62d326a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:18.583162 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5bb3cdc5-fb83-4139-bcad-7f31b62d326a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1318 microversion: 2.1 time: 0.149700 Aug 24 19:31:18.584064 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 117/248] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:18 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:18.610086 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ba537555-2d9f-4d2f-bd3f-498a40dbb95c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:18.611962 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ba537555-2d9f-4d2f-bd3f-498a40dbb95c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:18.621192 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ba537555-2d9f-4d2f-bd3f-498a40dbb95c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:18.622042 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ba537555-2d9f-4d2f-bd3f-498a40dbb95c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:18.622998 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ba537555-2d9f-4d2f-bd3f-498a40dbb95c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:18.623645 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ba537555-2d9f-4d2f-bd3f-498a40dbb95c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:18.731675 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4f912e8f-ac3d-46c6-baa8-2e47b66027f1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:18.742326 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4f912e8f-ac3d-46c6-baa8-2e47b66027f1 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1554 microversion: 2.1 time: 0.192523 Aug 24 19:31:18.742326 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 132/249] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:18 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:18.786218 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ba537555-2d9f-4d2f-bd3f-498a40dbb95c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:18.794702 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ba537555-2d9f-4d2f-bd3f-498a40dbb95c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.190817 Aug 24 19:31:18.796732 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 118/250] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:18 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:19.410356 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a6d3fed7-c15d-429a-876d-ae92cf9724b2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:19.422319 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a6d3fed7-c15d-429a-876d-ae92cf9724b2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:19.428862 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6d3fed7-c15d-429a-876d-ae92cf9724b2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:19.429317 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6d3fed7-c15d-429a-876d-ae92cf9724b2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:19.430635 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6d3fed7-c15d-429a-876d-ae92cf9724b2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:19.431394 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6d3fed7-c15d-429a-876d-ae92cf9724b2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:19.478446 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-de8eb2aa-ad34-44b2-bdf9-e69bd89c9fb5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:19.479587 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-de8eb2aa-ad34-44b2-bdf9-e69bd89c9fb5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:19.487064 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-de8eb2aa-ad34-44b2-bdf9-e69bd89c9fb5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:19.487064 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-de8eb2aa-ad34-44b2-bdf9-e69bd89c9fb5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:19.487492 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-de8eb2aa-ad34-44b2-bdf9-e69bd89c9fb5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:19.487919 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-de8eb2aa-ad34-44b2-bdf9-e69bd89c9fb5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:22.085108 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a6d3fed7-c15d-429a-876d-ae92cf9724b2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 24254 microversion: 2.20 time: 2.678713 Aug 24 19:31:22.085802 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 133/251] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:19 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 24254 bytes in 2680 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:22.091765 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-7c28207c-2c12-498e-bdb5-3ecd853b5a09 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:22.092477 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-7c28207c-2c12-498e-bdb5-3ecd853b5a09 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:22.099019 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7c28207c-2c12-498e-bdb5-3ecd853b5a09 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:22.099463 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7c28207c-2c12-498e-bdb5-3ecd853b5a09 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:22.100343 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7c28207c-2c12-498e-bdb5-3ecd853b5a09 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:22.100592 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-de8eb2aa-ad34-44b2-bdf9-e69bd89c9fb5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 24162 microversion: 2.1 time: 2.626074 Aug 24 19:31:22.101049 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7c28207c-2c12-498e-bdb5-3ecd853b5a09 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:22.107261 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 119/252] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:19 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 24162 bytes in 2628 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:31:22.107261 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-45dcdbd1-0835-469f-a430-c50900da8eb6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:22.107261 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-45dcdbd1-0835-469f-a430-c50900da8eb6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:22.113302 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-45dcdbd1-0835-469f-a430-c50900da8eb6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:22.113748 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-45dcdbd1-0835-469f-a430-c50900da8eb6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:22.114600 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-45dcdbd1-0835-469f-a430-c50900da8eb6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:22.115033 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-45dcdbd1-0835-469f-a430-c50900da8eb6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:22.282367 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-7c28207c-2c12-498e-bdb5-3ecd853b5a09 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:22.289176 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-45dcdbd1-0835-469f-a430-c50900da8eb6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:22.289599 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-7c28207c-2c12-498e-bdb5-3ecd853b5a09 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1318 microversion: 2.1 time: 0.201751 Aug 24 19:31:22.290170 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 134/253] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:22 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:22.294745 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-bc434b98-2620-44fb-9d7b-acde5b5c99ae tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:22.295346 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-bc434b98-2620-44fb-9d7b-acde5b5c99ae tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:22.297674 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-45dcdbd1-0835-469f-a430-c50900da8eb6 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1554 microversion: 2.1 time: 0.195040 Aug 24 19:31:22.298233 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 120/254] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:22 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:22.302043 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bc434b98-2620-44fb-9d7b-acde5b5c99ae tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:22.302688 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bc434b98-2620-44fb-9d7b-acde5b5c99ae tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:22.303258 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bc434b98-2620-44fb-9d7b-acde5b5c99ae tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:22.303679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bc434b98-2620-44fb-9d7b-acde5b5c99ae tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:22.304658 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-06227456-ce23-48a3-9d66-b74be1ddca17 req-e0f4d7e7-8afc-483f-8fc8-3ba08500665c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9dc0dd-298e-4b3f-8117-338c6322ecda", "name": "network-vif-plugged", "status": "completed", "tag": "882519cf-19ed-487a-b2db-37296318380e"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:22.306922 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:31:22.306922 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:31:22.313687 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-06227456-ce23-48a3-9d66-b74be1ddca17 req-e0f4d7e7-8afc-483f-8fc8-3ba08500665c service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:22.314216 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-06227456-ce23-48a3-9d66-b74be1ddca17 req-e0f4d7e7-8afc-483f-8fc8-3ba08500665c service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:22.326023 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-06227456-ce23-48a3-9d66-b74be1ddca17 req-e0f4d7e7-8afc-483f-8fc8-3ba08500665c service nova] Creating event network-vif-plugged:882519cf-19ed-487a-b2db-37296318380e for instance 9f9dc0dd-298e-4b3f-8117-338c6322ecda on hv-cinder-79819 Aug 24 19:31:22.330883 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-06227456-ce23-48a3-9d66-b74be1ddca17 req-e0f4d7e7-8afc-483f-8fc8-3ba08500665c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031398 Aug 24 19:31:22.331656 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 121/255] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:31:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:31:22.433591 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-bc434b98-2620-44fb-9d7b-acde5b5c99ae tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:22.441145 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-bc434b98-2620-44fb-9d7b-acde5b5c99ae tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.150018 Aug 24 19:31:22.441739 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 135/256] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:22 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:23.097678 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fedaa8fc-665b-4e89-ade9-1d0d48792ad0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:23.286409 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fedaa8fc-665b-4e89-ade9-1d0d48792ad0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:23.286409 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fedaa8fc-665b-4e89-ade9-1d0d48792ad0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:23.286409 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fedaa8fc-665b-4e89-ade9-1d0d48792ad0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:23.286409 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fedaa8fc-665b-4e89-ade9-1d0d48792ad0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:23.288085 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fedaa8fc-665b-4e89-ade9-1d0d48792ad0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:23.288579 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-da7c31ba-7966-4906-87d5-70c65adc1a2b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:23.288579 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-da7c31ba-7966-4906-87d5-70c65adc1a2b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:23.288579 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-da7c31ba-7966-4906-87d5-70c65adc1a2b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:23.288579 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-da7c31ba-7966-4906-87d5-70c65adc1a2b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:23.289273 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-da7c31ba-7966-4906-87d5-70c65adc1a2b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:23.289273 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-da7c31ba-7966-4906-87d5-70c65adc1a2b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:23.289977 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-fedaa8fc-665b-4e89-ade9-1d0d48792ad0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 25046 microversion: 2.20 time: 0.129590 Aug 24 19:31:23.289977 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 122/257] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:23 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 25046 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:23.307022 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-707fdc9c-8549-43c9-8167-6809a2c0ef9f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:23.307756 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-707fdc9c-8549-43c9-8167-6809a2c0ef9f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:23.315765 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-707fdc9c-8549-43c9-8167-6809a2c0ef9f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:23.316433 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-707fdc9c-8549-43c9-8167-6809a2c0ef9f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:23.317214 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-707fdc9c-8549-43c9-8167-6809a2c0ef9f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:23.317641 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-707fdc9c-8549-43c9-8167-6809a2c0ef9f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:23.361132 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-da7c31ba-7966-4906-87d5-70c65adc1a2b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 24821 microversion: 2.1 time: 0.247793 Aug 24 19:31:23.361789 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 136/258] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:23 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 24821 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:23.366939 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c05e8048-993b-47f6-8dcc-07a1fa6a86f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:23.367746 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-c05e8048-993b-47f6-8dcc-07a1fa6a86f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:23.374205 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c05e8048-993b-47f6-8dcc-07a1fa6a86f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:23.374653 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c05e8048-993b-47f6-8dcc-07a1fa6a86f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:23.375425 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c05e8048-993b-47f6-8dcc-07a1fa6a86f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:23.375856 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c05e8048-993b-47f6-8dcc-07a1fa6a86f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:23.604034 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-707fdc9c-8549-43c9-8167-6809a2c0ef9f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:23.611738 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-707fdc9c-8549-43c9-8167-6809a2c0ef9f tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1318 microversion: 2.1 time: 0.308817 Aug 24 19:31:23.612403 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 123/259] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:23 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:23.617004 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-61a3a993-449a-4407-90e4-b5a860e92772 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:23.618294 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-61a3a993-449a-4407-90e4-b5a860e92772 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:23.624449 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-61a3a993-449a-4407-90e4-b5a860e92772 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:23.624963 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-61a3a993-449a-4407-90e4-b5a860e92772 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:23.625793 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-61a3a993-449a-4407-90e4-b5a860e92772 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:23.626287 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-61a3a993-449a-4407-90e4-b5a860e92772 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:23.678037 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-c05e8048-993b-47f6-8dcc-07a1fa6a86f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:23.687117 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c05e8048-993b-47f6-8dcc-07a1fa6a86f8 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1554 microversion: 2.1 time: 0.324095 Aug 24 19:31:23.688165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 137/260] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:23 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1554 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:23.830922 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-61a3a993-449a-4407-90e4-b5a860e92772 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:23.839386 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-61a3a993-449a-4407-90e4-b5a860e92772 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.225774 Aug 24 19:31:23.841940 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 124/261] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:23 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:24.105215 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-d4e0e0e9-8e2b-4ab8-800b-c5233db37a10 req-ed699028-4839-424b-bda3-f4bcb2de8e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba289862-3027-492b-b4d1-d8539e4f3126", "name": "network-vif-deleted", "tag": "f5cceb43-bd57-4a70-b5d7-600c3c4c3870"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:24.110391 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:31:24.110391 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:31:24.113635 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-d4e0e0e9-8e2b-4ab8-800b-c5233db37a10 req-ed699028-4839-424b-bda3-f4bcb2de8e31 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:24.114053 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-d4e0e0e9-8e2b-4ab8-800b-c5233db37a10 req-ed699028-4839-424b-bda3-f4bcb2de8e31 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:24.124839 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-d4e0e0e9-8e2b-4ab8-800b-c5233db37a10 req-ed699028-4839-424b-bda3-f4bcb2de8e31 service nova] Creating event network-vif-deleted:f5cceb43-bd57-4a70-b5d7-600c3c4c3870 for instance ba289862-3027-492b-b4d1-d8539e4f3126 on hv-cinder-79819 Aug 24 19:31:24.129562 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-d4e0e0e9-8e2b-4ab8-800b-c5233db37a10 req-ed699028-4839-424b-bda3-f4bcb2de8e31 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028060 Aug 24 19:31:24.130118 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 138/262] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:31:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:31:24.288591 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-eaba8392-57ff-4b50-9449-70fb0b9d532c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:24.289550 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-eaba8392-57ff-4b50-9449-70fb0b9d532c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:24.295861 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eaba8392-57ff-4b50-9449-70fb0b9d532c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:24.296428 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eaba8392-57ff-4b50-9449-70fb0b9d532c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:24.297569 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eaba8392-57ff-4b50-9449-70fb0b9d532c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:24.298020 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eaba8392-57ff-4b50-9449-70fb0b9d532c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:24.373431 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-70a4ff6e-a1ab-42b8-b6bf-25e5ab20a24d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:24.374368 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-70a4ff6e-a1ab-42b8-b6bf-25e5ab20a24d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:24.381039 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-70a4ff6e-a1ab-42b8-b6bf-25e5ab20a24d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:24.381490 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-70a4ff6e-a1ab-42b8-b6bf-25e5ab20a24d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:24.382280 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-70a4ff6e-a1ab-42b8-b6bf-25e5ab20a24d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:24.383307 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-70a4ff6e-a1ab-42b8-b6bf-25e5ab20a24d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:24.405745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-eaba8392-57ff-4b50-9449-70fb0b9d532c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 25723 microversion: 2.20 time: 0.120756 Aug 24 19:31:24.406479 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 125/263] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:24 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 25723 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:24.503580 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-70a4ff6e-a1ab-42b8-b6bf-25e5ab20a24d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 25427 microversion: 2.1 time: 0.134138 Aug 24 19:31:24.504411 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 139/264] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:24 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 25427 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:31:24.629794 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-add37cef-ac06-4e01-b81e-c40562bf94ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:24.630395 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-add37cef-ac06-4e01-b81e-c40562bf94ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:24.637523 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-add37cef-ac06-4e01-b81e-c40562bf94ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:24.641033 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-add37cef-ac06-4e01-b81e-c40562bf94ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:24.641033 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-add37cef-ac06-4e01-b81e-c40562bf94ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:24.641033 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-add37cef-ac06-4e01-b81e-c40562bf94ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:24.704436 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-388de371-f9c0-48a7-8330-d21b50e5acc2 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:24.705438 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-388de371-f9c0-48a7-8330-d21b50e5acc2 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:24.711766 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-388de371-f9c0-48a7-8330-d21b50e5acc2 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:24.712215 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-388de371-f9c0-48a7-8330-d21b50e5acc2 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:24.713029 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-388de371-f9c0-48a7-8330-d21b50e5acc2 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:24.713461 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-388de371-f9c0-48a7-8330-d21b50e5acc2 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:24.784103 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-388de371-f9c0-48a7-8330-d21b50e5acc2 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1afabbd8a15f4bfc8649de7be75a4bed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2638f04be6a545859cf47a40a24cb9c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:24.787867 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-add37cef-ac06-4e01-b81e-c40562bf94ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:24.793381 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-388de371-f9c0-48a7-8330-d21b50e5acc2 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 200 len: 1346 microversion: 2.1 time: 0.092974 Aug 24 19:31:24.794390 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 140/265] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:24 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:24.795698 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-add37cef-ac06-4e01-b81e-c40562bf94ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1507 microversion: 2.1 time: 0.169966 Aug 24 19:31:24.796709 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 126/266] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:24 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:24.819432 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c20c9bc9-2dcb-49de-be66-3fb6e6e5a0ec tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8e4cf5a-22e0-4aea-bab4-4dd678400cba"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:24.821183 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-c20c9bc9-2dcb-49de-be66-3fb6e6e5a0ec tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:24.826975 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c20c9bc9-2dcb-49de-be66-3fb6e6e5a0ec tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:24.830708 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c20c9bc9-2dcb-49de-be66-3fb6e6e5a0ec tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:24.830708 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c20c9bc9-2dcb-49de-be66-3fb6e6e5a0ec tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:24.830708 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c20c9bc9-2dcb-49de-be66-3fb6e6e5a0ec tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:24.856591 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c4b276a3-b074-48d6-9b29-a9990b22415e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:24.859614 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c4b276a3-b074-48d6-9b29-a9990b22415e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:24.863435 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c4b276a3-b074-48d6-9b29-a9990b22415e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:24.863980 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c4b276a3-b074-48d6-9b29-a9990b22415e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:24.864825 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c4b276a3-b074-48d6-9b29-a9990b22415e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:24.865421 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c4b276a3-b074-48d6-9b29-a9990b22415e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:24.913807 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-c20c9bc9-2dcb-49de-be66-3fb6e6e5a0ec tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] HTTP exception thrown: Invalid volume: volume c8e4cf5a-22e0-4aea-bab4-4dd678400cba is already attached to instances: fd316c0d-59a0-4082-91a9-019af34e063b Aug 24 19:31:24.914498 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c20c9bc9-2dcb-49de-be66-3fb6e6e5a0ec tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Returning 400 to user: Invalid volume: volume c8e4cf5a-22e0-4aea-bab4-4dd678400cba is already attached to instances: fd316c0d-59a0-4082-91a9-019af34e063b {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:31:24.915192 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c20c9bc9-2dcb-49de-be66-3fb6e6e5a0ec tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "POST /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099812 Aug 24 19:31:24.916059 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 141/267] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 24 19:31:24 2021] POST /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 19:31:24.995814 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0c2611e3-3b70-43d7-8ded-68c8c5ce7ca3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:24.996494 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0c2611e3-3b70-43d7-8ded-68c8c5ce7ca3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:25.010259 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0c2611e3-3b70-43d7-8ded-68c8c5ce7ca3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:25.011010 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0c2611e3-3b70-43d7-8ded-68c8c5ce7ca3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:25.012218 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0c2611e3-3b70-43d7-8ded-68c8c5ce7ca3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:25.013645 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0c2611e3-3b70-43d7-8ded-68c8c5ce7ca3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:25.032759 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c4b276a3-b074-48d6-9b29-a9990b22415e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:25.042130 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c4b276a3-b074-48d6-9b29-a9990b22415e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.188138 Aug 24 19:31:25.042715 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 127/268] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:24 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:25.163423 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.objects.instance [None req-0c2611e3-3b70-43d7-8ded-68c8c5ce7ca3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lazy-loading 'services' on Instance uuid fd316c0d-59a0-4082-91a9-019af34e063b {{(pid=108908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:31:25.417455 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-910b7385-c13d-4d4a-b54b-85ea5087a60b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:25.420961 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-910b7385-c13d-4d4a-b54b-85ea5087a60b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:25.424697 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-910b7385-c13d-4d4a-b54b-85ea5087a60b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:25.425201 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-910b7385-c13d-4d4a-b54b-85ea5087a60b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:25.426016 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-910b7385-c13d-4d4a-b54b-85ea5087a60b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:25.426437 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-910b7385-c13d-4d4a-b54b-85ea5087a60b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:25.516123 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0c2611e3-3b70-43d7-8ded-68c8c5ce7ca3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b/os-volume_attachments/c8e4cf5a-22e0-4aea-bab4-4dd678400cba" status: 202 len: 0 microversion: 2.1 time: 0.524505 Aug 24 19:31:25.517346 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 142/269] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 24 19:31:24 2021] DELETE /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b/os-volume_attachments/c8e4cf5a-22e0-4aea-bab4-4dd678400cba => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:25.522084 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-bbefbbf0-9e02-4e9d-9bbc-bb69828d7e4b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:25.523311 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-bbefbbf0-9e02-4e9d-9bbc-bb69828d7e4b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:25.526947 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-910b7385-c13d-4d4a-b54b-85ea5087a60b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 26379 microversion: 2.20 time: 0.113139 Aug 24 19:31:25.528150 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 128/270] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:25 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 26379 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:25.529400 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bbefbbf0-9e02-4e9d-9bbc-bb69828d7e4b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:25.529907 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bbefbbf0-9e02-4e9d-9bbc-bb69828d7e4b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:25.530710 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bbefbbf0-9e02-4e9d-9bbc-bb69828d7e4b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:25.531200 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bbefbbf0-9e02-4e9d-9bbc-bb69828d7e4b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:25.533000 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-576ce803-db05-4c05-97d1-b047245b0dd2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:25.534215 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-576ce803-db05-4c05-97d1-b047245b0dd2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:25.540741 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-576ce803-db05-4c05-97d1-b047245b0dd2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:25.541187 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-576ce803-db05-4c05-97d1-b047245b0dd2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:25.542099 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-576ce803-db05-4c05-97d1-b047245b0dd2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:25.542516 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-576ce803-db05-4c05-97d1-b047245b0dd2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:25.573139 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-576ce803-db05-4c05-97d1-b047245b0dd2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044355 Aug 24 19:31:25.573698 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 129/271] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:31:25 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:31:25.622615 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-bbefbbf0-9e02-4e9d-9bbc-bb69828d7e4b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 26102 microversion: 2.1 time: 0.104191 Aug 24 19:31:25.623317 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 143/272] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:25 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 26102 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:25.811186 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-620eb2ab-4ea7-414a-8349-1506516d58f7 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:25.811792 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-620eb2ab-4ea7-414a-8349-1506516d58f7 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:25.817608 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-620eb2ab-4ea7-414a-8349-1506516d58f7 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:25.818001 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-620eb2ab-4ea7-414a-8349-1506516d58f7 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:25.818762 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-620eb2ab-4ea7-414a-8349-1506516d58f7 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:25.819191 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-620eb2ab-4ea7-414a-8349-1506516d58f7 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:25.832840 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-620eb2ab-4ea7-414a-8349-1506516d58f7 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] HTTP exception thrown: Instance ba289862-3027-492b-b4d1-d8539e4f3126 could not be found. Aug 24 19:31:25.833434 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-620eb2ab-4ea7-414a-8349-1506516d58f7 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Returning 404 to user: Instance ba289862-3027-492b-b4d1-d8539e4f3126 could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:31:25.834281 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-620eb2ab-4ea7-414a-8349-1506516d58f7 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 404 len: 111 microversion: 2.1 time: 0.026783 Aug 24 19:31:25.834828 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 130/273] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:25 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 19:31:25.944987 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2d73aae5-1526-4900-92ba-857fecdcfe39 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:25.946252 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2d73aae5-1526-4900-92ba-857fecdcfe39 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:25.952897 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2d73aae5-1526-4900-92ba-857fecdcfe39 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:25.955669 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2d73aae5-1526-4900-92ba-857fecdcfe39 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:25.955669 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2d73aae5-1526-4900-92ba-857fecdcfe39 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:25.955669 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2d73aae5-1526-4900-92ba-857fecdcfe39 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:25.967257 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-2d73aae5-1526-4900-92ba-857fecdcfe39 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] HTTP exception thrown: Instance ba289862-3027-492b-b4d1-d8539e4f3126 could not be found. Aug 24 19:31:25.967846 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2d73aae5-1526-4900-92ba-857fecdcfe39 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Returning 404 to user: Instance ba289862-3027-492b-b4d1-d8539e4f3126 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:31:25.968698 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2d73aae5-1526-4900-92ba-857fecdcfe39 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028223 Aug 24 19:31:25.969229 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 144/274] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:31:25 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:31:26.060623 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4729edc3-5650-4dd7-a20f-54565a4bffe8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:26.061431 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4729edc3-5650-4dd7-a20f-54565a4bffe8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:26.068914 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4729edc3-5650-4dd7-a20f-54565a4bffe8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:26.069565 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4729edc3-5650-4dd7-a20f-54565a4bffe8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:26.070445 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4729edc3-5650-4dd7-a20f-54565a4bffe8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:26.070941 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4729edc3-5650-4dd7-a20f-54565a4bffe8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:26.194759 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4729edc3-5650-4dd7-a20f-54565a4bffe8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:26.202225 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4729edc3-5650-4dd7-a20f-54565a4bffe8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.147113 Aug 24 19:31:26.202784 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 131/275] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:26 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:26.539640 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b3fcad16-43e0-47f3-973a-c0c8fceaeca6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:26.540607 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b3fcad16-43e0-47f3-973a-c0c8fceaeca6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:26.546502 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b3fcad16-43e0-47f3-973a-c0c8fceaeca6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:26.547200 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b3fcad16-43e0-47f3-973a-c0c8fceaeca6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:26.547960 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b3fcad16-43e0-47f3-973a-c0c8fceaeca6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:26.548411 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b3fcad16-43e0-47f3-973a-c0c8fceaeca6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:26.620096 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4da178a6-ecc8-4fcb-bda4-f37a3109baa2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:26.621433 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4da178a6-ecc8-4fcb-bda4-f37a3109baa2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:26.630167 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4da178a6-ecc8-4fcb-bda4-f37a3109baa2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:26.631614 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4da178a6-ecc8-4fcb-bda4-f37a3109baa2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:26.631995 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4da178a6-ecc8-4fcb-bda4-f37a3109baa2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:26.632982 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4da178a6-ecc8-4fcb-bda4-f37a3109baa2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:26.652614 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b3fcad16-43e0-47f3-973a-c0c8fceaeca6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 26878 microversion: 2.20 time: 0.116654 Aug 24 19:31:26.657080 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 145/276] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:26 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 26878 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:26.661697 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-17d8ea4a-72ed-4af2-b0dd-5c33b2b4a689 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:26.662700 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-17d8ea4a-72ed-4af2-b0dd-5c33b2b4a689 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:26.666809 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4da178a6-ecc8-4fcb-bda4-f37a3109baa2 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050413 Aug 24 19:31:26.667442 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 132/277] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:31:26 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:31:26.669130 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-17d8ea4a-72ed-4af2-b0dd-5c33b2b4a689 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:26.669575 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-17d8ea4a-72ed-4af2-b0dd-5c33b2b4a689 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:26.670335 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-17d8ea4a-72ed-4af2-b0dd-5c33b2b4a689 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:26.670760 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-17d8ea4a-72ed-4af2-b0dd-5c33b2b4a689 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:26.770375 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-17d8ea4a-72ed-4af2-b0dd-5c33b2b4a689 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 26647 microversion: 2.1 time: 0.112275 Aug 24 19:31:26.771036 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 146/278] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:26 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 26647 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:27.218769 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4d425778-e327-438f-b245-cf8bc1d8a504 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:27.219357 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4d425778-e327-438f-b245-cf8bc1d8a504 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:27.225455 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4d425778-e327-438f-b245-cf8bc1d8a504 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:27.225895 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4d425778-e327-438f-b245-cf8bc1d8a504 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:27.227129 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4d425778-e327-438f-b245-cf8bc1d8a504 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:27.233906 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4d425778-e327-438f-b245-cf8bc1d8a504 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:27.346600 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4d425778-e327-438f-b245-cf8bc1d8a504 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:27.354436 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4d425778-e327-438f-b245-cf8bc1d8a504 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.139324 Aug 24 19:31:27.354994 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 133/279] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:27 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:27.435346 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-42febdba-5d12-4e0a-8b45-7b79c23d0d6c tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:27.435925 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-42febdba-5d12-4e0a-8b45-7b79c23d0d6c tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:27.442206 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42febdba-5d12-4e0a-8b45-7b79c23d0d6c tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:27.442652 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42febdba-5d12-4e0a-8b45-7b79c23d0d6c tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:27.443411 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42febdba-5d12-4e0a-8b45-7b79c23d0d6c tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:27.443840 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42febdba-5d12-4e0a-8b45-7b79c23d0d6c tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:27.456931 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-42febdba-5d12-4e0a-8b45-7b79c23d0d6c tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] HTTP exception thrown: Instance ba289862-3027-492b-b4d1-d8539e4f3126 could not be found. Aug 24 19:31:27.457503 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-42febdba-5d12-4e0a-8b45-7b79c23d0d6c tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Returning 404 to user: Instance ba289862-3027-492b-b4d1-d8539e4f3126 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:31:27.458300 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-42febdba-5d12-4e0a-8b45-7b79c23d0d6c tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 404 len: 111 microversion: 2.1 time: 0.027215 Aug 24 19:31:27.458821 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 147/280] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:31:27 2021] DELETE /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:31:27.466997 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f0165140-6913-481f-9a84-8e3414c5d818 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:27.467625 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f0165140-6913-481f-9a84-8e3414c5d818 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] [instance: ba289862-3027-492b-b4d1-d8539e4f3126] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:27.473464 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0165140-6913-481f-9a84-8e3414c5d818 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:27.480375 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0165140-6913-481f-9a84-8e3414c5d818 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:27.480375 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0165140-6913-481f-9a84-8e3414c5d818 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:27.480375 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0165140-6913-481f-9a84-8e3414c5d818 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:27.488752 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-f0165140-6913-481f-9a84-8e3414c5d818 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] HTTP exception thrown: Instance ba289862-3027-492b-b4d1-d8539e4f3126 could not be found. Aug 24 19:31:27.489318 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f0165140-6913-481f-9a84-8e3414c5d818 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] Returning 404 to user: Instance ba289862-3027-492b-b4d1-d8539e4f3126 could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:31:27.490166 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f0165140-6913-481f-9a84-8e3414c5d818 tempest-DeleteServersTestJSON-229464824 tempest-DeleteServersTestJSON-229464824-project] 10.222.0.59 "GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126" status: 404 len: 111 microversion: 2.1 time: 0.026811 Aug 24 19:31:27.490665 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 134/281] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:27 2021] GET /compute/v2.1/servers/ba289862-3027-492b-b4d1-d8539e4f3126 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:31:27.665594 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0be5cca4-c009-4a4a-b743-0364a87ab615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:27.666528 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0be5cca4-c009-4a4a-b743-0364a87ab615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:27.672744 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0be5cca4-c009-4a4a-b743-0364a87ab615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:27.673198 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0be5cca4-c009-4a4a-b743-0364a87ab615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:27.674085 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0be5cca4-c009-4a4a-b743-0364a87ab615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:27.674518 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0be5cca4-c009-4a4a-b743-0364a87ab615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:27.678508 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d95647e6-34fd-4845-b139-58bf49c82cd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:27.679879 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d95647e6-34fd-4845-b139-58bf49c82cd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:27.685582 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d95647e6-34fd-4845-b139-58bf49c82cd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:27.686022 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d95647e6-34fd-4845-b139-58bf49c82cd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:27.686780 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d95647e6-34fd-4845-b139-58bf49c82cd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:27.687203 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d95647e6-34fd-4845-b139-58bf49c82cd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:27.719576 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d95647e6-34fd-4845-b139-58bf49c82cd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044684 Aug 24 19:31:27.720184 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 135/282] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:31:27 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 19:31:27.780808 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0be5cca4-c009-4a4a-b743-0364a87ab615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 27445 microversion: 2.20 time: 0.119319 Aug 24 19:31:27.793112 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 148/283] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:27 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 27445 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:27.793879 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-74582848-1838-472b-af12-b147cac75ec5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:27.793879 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-74582848-1838-472b-af12-b147cac75ec5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:27.804492 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74582848-1838-472b-af12-b147cac75ec5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:27.804918 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74582848-1838-472b-af12-b147cac75ec5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:27.805832 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74582848-1838-472b-af12-b147cac75ec5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:27.806377 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74582848-1838-472b-af12-b147cac75ec5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:27.879166 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-893391110", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "networks": [{"uuid": "6a1a130c-ef7c-4e9a-95ba-539471ebdef0"}]}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:27.908739 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-74582848-1838-472b-af12-b147cac75ec5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 27109 microversion: 2.1 time: 0.120110 Aug 24 19:31:27.913745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 136/284] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:27 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 27109 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:27.938940 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.network.neutron [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] validate_networks() for [('6a1a130c-ef7c-4e9a-95ba-539471ebdef0', None, None, None, None, None)] {{(pid=108908) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:31:28.327168 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Flavor limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:31:28.327589 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Image limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:31:28.328064 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Flavor pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:31:28.328515 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Image pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:31:28.328959 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:31:28.337907 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:28.338345 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:28.339133 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:28.339558 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:28.355700 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Getting quotas for project 7a54174229cb4b11bc07726eece4a2af. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:31:28.359535 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Getting quotas for user 3c437fd9d3774ba58eb9b4726b7667b5 and project 7a54174229cb4b11bc07726eece4a2af. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:31:28.373592 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Going to run 1 instances... {{(pid=108908) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:31:28.375640 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-15095613-c1cf-46dd-8915-b3334479764c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:28.377038 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:31:28.377327 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-15095613-c1cf-46dd-8915-b3334479764c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:28.384918 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-15095613-c1cf-46dd-8915-b3334479764c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:28.385445 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-15095613-c1cf-46dd-8915-b3334479764c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:28.386353 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-15095613-c1cf-46dd-8915-b3334479764c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:28.386877 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-15095613-c1cf-46dd-8915-b3334479764c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:28.508379 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-15095613-c1cf-46dd-8915-b3334479764c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:28.516013 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-15095613-c1cf-46dd-8915-b3334479764c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.146168 Aug 24 19:31:28.516606 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 137/285] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:28 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:28.569647 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6f1168ad-0ebe-4dad-9090-6e24f859a922 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.694573 Aug 24 19:31:28.571037 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 149/286] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:31:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 19:31:28.581582 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5541d06f-8149-4c35-bb8f-cd29a33cd3a0 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:28.582453 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5541d06f-8149-4c35-bb8f-cd29a33cd3a0 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:28.636921 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5541d06f-8149-4c35-bb8f-cd29a33cd3a0 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:28.643628 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5541d06f-8149-4c35-bb8f-cd29a33cd3a0 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1217 microversion: 2.1 time: 0.066474 Aug 24 19:31:28.648926 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 138/287] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:28 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:28.803164 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-89d8e77e-1773-45c9-a9a1-3097ffe67626 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:28.804865 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-89d8e77e-1773-45c9-a9a1-3097ffe67626 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:28.810974 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89d8e77e-1773-45c9-a9a1-3097ffe67626 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:28.811440 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89d8e77e-1773-45c9-a9a1-3097ffe67626 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:28.812187 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89d8e77e-1773-45c9-a9a1-3097ffe67626 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:28.812643 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89d8e77e-1773-45c9-a9a1-3097ffe67626 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:28.898009 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-89d8e77e-1773-45c9-a9a1-3097ffe67626 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 27640 microversion: 2.20 time: 0.098333 Aug 24 19:31:28.901797 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 150/288] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:28 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 27640 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:28.925832 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6ad87b9d-7f88-48ea-9488-aafe3489a9fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:28.928669 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6ad87b9d-7f88-48ea-9488-aafe3489a9fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:28.933470 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6ad87b9d-7f88-48ea-9488-aafe3489a9fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:28.933918 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6ad87b9d-7f88-48ea-9488-aafe3489a9fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:28.934710 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6ad87b9d-7f88-48ea-9488-aafe3489a9fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:28.935124 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6ad87b9d-7f88-48ea-9488-aafe3489a9fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:29.037359 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6ad87b9d-7f88-48ea-9488-aafe3489a9fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 27499 microversion: 2.1 time: 0.115267 Aug 24 19:31:29.038004 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 139/289] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:28 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 27499 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:29.533349 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-cd9b50bc-febc-40d2-9f5a-2242dffa9250 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:29.534340 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-cd9b50bc-febc-40d2-9f5a-2242dffa9250 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:29.541944 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cd9b50bc-febc-40d2-9f5a-2242dffa9250 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:29.542255 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cd9b50bc-febc-40d2-9f5a-2242dffa9250 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:29.543026 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cd9b50bc-febc-40d2-9f5a-2242dffa9250 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:29.543462 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cd9b50bc-febc-40d2-9f5a-2242dffa9250 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:29.660578 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d7962782-6f26-49d1-961a-096412b4f649 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:29.661329 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d7962782-6f26-49d1-961a-096412b4f649 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:29.662750 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-cd9b50bc-febc-40d2-9f5a-2242dffa9250 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:29.670087 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-cd9b50bc-febc-40d2-9f5a-2242dffa9250 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.140902 Aug 24 19:31:29.672177 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 151/290] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:29 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:29.712659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-d7962782-6f26-49d1-961a-096412b4f649 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:29.719045 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d7962782-6f26-49d1-961a-096412b4f649 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1217 microversion: 2.1 time: 0.062540 Aug 24 19:31:29.719600 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 140/291] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:29 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1217 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:29.914364 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-397d4649-3016-45f1-b009-0bbd294ab595 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:29.922784 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-397d4649-3016-45f1-b009-0bbd294ab595 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:29.928738 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-397d4649-3016-45f1-b009-0bbd294ab595 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:29.929178 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-397d4649-3016-45f1-b009-0bbd294ab595 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:29.929962 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-397d4649-3016-45f1-b009-0bbd294ab595 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:29.930375 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-397d4649-3016-45f1-b009-0bbd294ab595 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:30.051558 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8c0069ce-d111-4675-b8e7-b7a192f9aae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:30.052408 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8c0069ce-d111-4675-b8e7-b7a192f9aae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:30.059565 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8c0069ce-d111-4675-b8e7-b7a192f9aae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:30.059936 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8c0069ce-d111-4675-b8e7-b7a192f9aae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:30.060728 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8c0069ce-d111-4675-b8e7-b7a192f9aae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:30.061152 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8c0069ce-d111-4675-b8e7-b7a192f9aae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:32.222895 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8c0069ce-d111-4675-b8e7-b7a192f9aae8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 27811 microversion: 2.1 time: 2.174843 Aug 24 19:31:32.225676 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 141/292] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:30 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 27811 bytes in 2177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:32.230049 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-03145e25-77ee-4c9b-a557-57f8b639bacd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:32.230743 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-03145e25-77ee-4c9b-a557-57f8b639bacd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:32.237597 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-03145e25-77ee-4c9b-a557-57f8b639bacd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:32.238142 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-03145e25-77ee-4c9b-a557-57f8b639bacd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:32.238960 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-03145e25-77ee-4c9b-a557-57f8b639bacd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:32.239394 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-03145e25-77ee-4c9b-a557-57f8b639bacd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:32.246886 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-397d4649-3016-45f1-b009-0bbd294ab595 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 27921 microversion: 2.20 time: 2.336394 Aug 24 19:31:32.248353 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 152/293] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:29 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 27921 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:32.255521 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-52c866cd-95e6-4dd2-8d79-cb8879db4180 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:32.259876 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-52c866cd-95e6-4dd2-8d79-cb8879db4180 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:32.263132 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52c866cd-95e6-4dd2-8d79-cb8879db4180 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:32.263623 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52c866cd-95e6-4dd2-8d79-cb8879db4180 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:32.264414 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52c866cd-95e6-4dd2-8d79-cb8879db4180 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:32.264839 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52c866cd-95e6-4dd2-8d79-cb8879db4180 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:32.340197 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-52c866cd-95e6-4dd2-8d79-cb8879db4180 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:32.348029 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-52c866cd-95e6-4dd2-8d79-cb8879db4180 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1221 microversion: 2.1 time: 0.098048 Aug 24 19:31:32.348660 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 153/294] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:32 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1221 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:32.392819 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-03145e25-77ee-4c9b-a557-57f8b639bacd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:32.400980 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-03145e25-77ee-4c9b-a557-57f8b639bacd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.175860 Aug 24 19:31:32.401547 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 142/295] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:32 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:33.234974 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-aa751a7c-4d83-4fa3-8338-25bceacae4d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:33.236256 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-aa751a7c-4d83-4fa3-8338-25bceacae4d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:33.245212 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aa751a7c-4d83-4fa3-8338-25bceacae4d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:33.245212 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aa751a7c-4d83-4fa3-8338-25bceacae4d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:33.245212 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aa751a7c-4d83-4fa3-8338-25bceacae4d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:33.245212 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aa751a7c-4d83-4fa3-8338-25bceacae4d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:33.260862 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6685c47c-20d9-4b4d-935c-526d084fc4d5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:33.262437 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6685c47c-20d9-4b4d-935c-526d084fc4d5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:33.274429 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6685c47c-20d9-4b4d-935c-526d084fc4d5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:33.275154 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6685c47c-20d9-4b4d-935c-526d084fc4d5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:33.276057 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6685c47c-20d9-4b4d-935c-526d084fc4d5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:33.276654 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6685c47c-20d9-4b4d-935c-526d084fc4d5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:33.356202 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-aa751a7c-4d83-4fa3-8338-25bceacae4d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 28171 microversion: 2.1 time: 0.124909 Aug 24 19:31:33.356996 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 154/296] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:33 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 28171 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:33.368039 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-050d7900-e754-4b7f-ac77-c51c6fabd111 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:33.369387 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-050d7900-e754-4b7f-ac77-c51c6fabd111 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:33.394310 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-050d7900-e754-4b7f-ac77-c51c6fabd111 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:33.394310 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-050d7900-e754-4b7f-ac77-c51c6fabd111 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:33.394310 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-050d7900-e754-4b7f-ac77-c51c6fabd111 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:33.394310 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-050d7900-e754-4b7f-ac77-c51c6fabd111 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:33.397099 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6685c47c-20d9-4b4d-935c-526d084fc4d5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 28103 microversion: 2.20 time: 0.140028 Aug 24 19:31:33.402083 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 143/297] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:33 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 28103 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:33.418958 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-191e7f63-f2c1-4d3e-92cc-1f7d88a29fc3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:33.419659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-191e7f63-f2c1-4d3e-92cc-1f7d88a29fc3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:33.426601 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-191e7f63-f2c1-4d3e-92cc-1f7d88a29fc3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:33.427044 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-191e7f63-f2c1-4d3e-92cc-1f7d88a29fc3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:33.427844 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-191e7f63-f2c1-4d3e-92cc-1f7d88a29fc3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:33.428502 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-191e7f63-f2c1-4d3e-92cc-1f7d88a29fc3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:33.449778 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-050d7900-e754-4b7f-ac77-c51c6fabd111 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:33.457409 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-050d7900-e754-4b7f-ac77-c51c6fabd111 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1269 microversion: 2.1 time: 0.093706 Aug 24 19:31:33.458037 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 155/298] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:33 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1269 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:33.554837 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-191e7f63-f2c1-4d3e-92cc-1f7d88a29fc3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:33.562373 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-191e7f63-f2c1-4d3e-92cc-1f7d88a29fc3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.147972 Aug 24 19:31:33.562870 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 144/299] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:33 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:34.368826 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-22424035-1d55-465f-8aee-c84b7fb386c4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:34.371829 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-22424035-1d55-465f-8aee-c84b7fb386c4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:34.382433 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-22424035-1d55-465f-8aee-c84b7fb386c4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:34.382921 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-22424035-1d55-465f-8aee-c84b7fb386c4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:34.384612 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-22424035-1d55-465f-8aee-c84b7fb386c4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:34.384744 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-22424035-1d55-465f-8aee-c84b7fb386c4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:34.415892 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-cb7f0ff4-4f6c-45dd-a2b0-fc11fad6a03d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:34.415892 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-cb7f0ff4-4f6c-45dd-a2b0-fc11fad6a03d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:34.426554 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cb7f0ff4-4f6c-45dd-a2b0-fc11fad6a03d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:34.427736 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cb7f0ff4-4f6c-45dd-a2b0-fc11fad6a03d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:34.428957 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cb7f0ff4-4f6c-45dd-a2b0-fc11fad6a03d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:34.431200 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cb7f0ff4-4f6c-45dd-a2b0-fc11fad6a03d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:34.459222 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-22424035-1d55-465f-8aee-c84b7fb386c4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 28171 microversion: 2.1 time: 0.093914 Aug 24 19:31:34.459970 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 156/300] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:34 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 28171 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:34.475889 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-acf5976c-eb89-4614-a3e6-0871602a4e97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:34.476842 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-acf5976c-eb89-4614-a3e6-0871602a4e97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:34.486679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-acf5976c-eb89-4614-a3e6-0871602a4e97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:34.490590 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-acf5976c-eb89-4614-a3e6-0871602a4e97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:34.492531 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-acf5976c-eb89-4614-a3e6-0871602a4e97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:34.492995 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-acf5976c-eb89-4614-a3e6-0871602a4e97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:34.529641 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-cb7f0ff4-4f6c-45dd-a2b0-fc11fad6a03d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 28103 microversion: 2.20 time: 0.122182 Aug 24 19:31:34.530302 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 145/301] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:34 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 28103 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:34.573280 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-acf5976c-eb89-4614-a3e6-0871602a4e97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:34.580818 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e0ccebfb-7b6c-4708-86a1-db329f9bd091 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:34.581734 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e0ccebfb-7b6c-4708-86a1-db329f9bd091 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:34.582511 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-acf5976c-eb89-4614-a3e6-0871602a4e97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1275 microversion: 2.1 time: 0.111061 Aug 24 19:31:34.591803 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 157/302] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:34 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1275 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:34.597876 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e0ccebfb-7b6c-4708-86a1-db329f9bd091 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:34.598318 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e0ccebfb-7b6c-4708-86a1-db329f9bd091 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:34.599207 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e0ccebfb-7b6c-4708-86a1-db329f9bd091 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:34.599641 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e0ccebfb-7b6c-4708-86a1-db329f9bd091 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:34.792112 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e0ccebfb-7b6c-4708-86a1-db329f9bd091 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:34.804470 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e0ccebfb-7b6c-4708-86a1-db329f9bd091 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.227775 Aug 24 19:31:34.806909 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 146/303] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:34 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:35.479690 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-79ce9201-47a9-4788-ba75-86576fdbd01d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:35.480995 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-79ce9201-47a9-4788-ba75-86576fdbd01d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:35.494624 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-79ce9201-47a9-4788-ba75-86576fdbd01d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:35.494624 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-79ce9201-47a9-4788-ba75-86576fdbd01d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:35.495378 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-79ce9201-47a9-4788-ba75-86576fdbd01d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:35.495838 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-79ce9201-47a9-4788-ba75-86576fdbd01d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:35.546464 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-429d14b3-42b7-4f29-9aaf-87d4aed3ad8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:35.548384 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-429d14b3-42b7-4f29-9aaf-87d4aed3ad8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:35.556033 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-429d14b3-42b7-4f29-9aaf-87d4aed3ad8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:35.556504 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-429d14b3-42b7-4f29-9aaf-87d4aed3ad8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:35.557365 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-429d14b3-42b7-4f29-9aaf-87d4aed3ad8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:35.557794 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-429d14b3-42b7-4f29-9aaf-87d4aed3ad8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:35.573872 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-79ce9201-47a9-4788-ba75-86576fdbd01d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 28171 microversion: 2.1 time: 0.099489 Aug 24 19:31:35.575955 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 158/304] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:35 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 28171 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:35.603554 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-fe55d5e0-4d17-46eb-b5a3-808e8175b3bc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:35.604687 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-fe55d5e0-4d17-46eb-b5a3-808e8175b3bc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:35.612945 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fe55d5e0-4d17-46eb-b5a3-808e8175b3bc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:35.614321 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fe55d5e0-4d17-46eb-b5a3-808e8175b3bc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:35.615341 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fe55d5e0-4d17-46eb-b5a3-808e8175b3bc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:35.616458 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fe55d5e0-4d17-46eb-b5a3-808e8175b3bc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:35.685599 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-429d14b3-42b7-4f29-9aaf-87d4aed3ad8a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 28314 microversion: 2.20 time: 0.143426 Aug 24 19:31:35.686217 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 147/305] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:35 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 28314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:35.827327 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-46ce7809-d950-4882-b50b-f95ecc5fa764 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:35.828182 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-46ce7809-d950-4882-b50b-f95ecc5fa764 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:35.839581 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-46ce7809-d950-4882-b50b-f95ecc5fa764 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:35.840448 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-46ce7809-d950-4882-b50b-f95ecc5fa764 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:35.841316 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-46ce7809-d950-4882-b50b-f95ecc5fa764 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:35.841753 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-46ce7809-d950-4882-b50b-f95ecc5fa764 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:35.881603 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-fe55d5e0-4d17-46eb-b5a3-808e8175b3bc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:35.891803 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-fe55d5e0-4d17-46eb-b5a3-808e8175b3bc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1317 microversion: 2.1 time: 0.294830 Aug 24 19:31:35.893136 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 159/306] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:35 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:36.161880 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-71a1b2f5-0bdb-4e10-9e92-3180139404d9 req-40ae91c9-3f81-4a44-b922-65b99fbf7937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "554e6201-ec34-45b3-ad25-7eba945122f0", "tag": "a907cbe7-3847-4d97-9c08-0319637b734f"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:36.165909 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:31:36.165909 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:31:36.170875 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-71a1b2f5-0bdb-4e10-9e92-3180139404d9 req-40ae91c9-3f81-4a44-b922-65b99fbf7937 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:36.171950 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-71a1b2f5-0bdb-4e10-9e92-3180139404d9 req-40ae91c9-3f81-4a44-b922-65b99fbf7937 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:36.183405 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-71a1b2f5-0bdb-4e10-9e92-3180139404d9 req-40ae91c9-3f81-4a44-b922-65b99fbf7937 service nova] Creating event network-changed:a907cbe7-3847-4d97-9c08-0319637b734f for instance 554e6201-ec34-45b3-ad25-7eba945122f0 on hv-cinder-79819 Aug 24 19:31:36.188589 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-71a1b2f5-0bdb-4e10-9e92-3180139404d9 req-40ae91c9-3f81-4a44-b922-65b99fbf7937 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030173 Aug 24 19:31:36.189354 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 160/307] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:31:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:31:36.208877 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-46ce7809-d950-4882-b50b-f95ecc5fa764 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:36.216950 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-46ce7809-d950-4882-b50b-f95ecc5fa764 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.396788 Aug 24 19:31:36.217527 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 148/308] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:35 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:36.588135 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5eb930a0-4951-48d6-b139-b461048985aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:36.590437 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5eb930a0-4951-48d6-b139-b461048985aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:36.595967 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5eb930a0-4951-48d6-b139-b461048985aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:36.596693 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5eb930a0-4951-48d6-b139-b461048985aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:36.597932 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5eb930a0-4951-48d6-b139-b461048985aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:36.598524 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5eb930a0-4951-48d6-b139-b461048985aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:36.689075 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5eb930a0-4951-48d6-b139-b461048985aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 28462 microversion: 2.1 time: 0.105522 Aug 24 19:31:36.689984 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 161/309] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:36 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 28462 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:36.697745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c7bfc4b1-d63c-4179-a44a-2d1f1a28784c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:36.698746 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c7bfc4b1-d63c-4179-a44a-2d1f1a28784c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:36.705001 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7bfc4b1-d63c-4179-a44a-2d1f1a28784c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:36.705476 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7bfc4b1-d63c-4179-a44a-2d1f1a28784c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:36.706238 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7bfc4b1-d63c-4179-a44a-2d1f1a28784c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:36.706827 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7bfc4b1-d63c-4179-a44a-2d1f1a28784c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:36.793530 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c7bfc4b1-d63c-4179-a44a-2d1f1a28784c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 28393 microversion: 2.20 time: 0.099762 Aug 24 19:31:36.794374 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 149/310] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:36 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 28393 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:36.909242 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ab1a9d01-31fa-4efd-b414-f127f879a55a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:36.910039 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ab1a9d01-31fa-4efd-b414-f127f879a55a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:36.916925 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ab1a9d01-31fa-4efd-b414-f127f879a55a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:36.917615 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ab1a9d01-31fa-4efd-b414-f127f879a55a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:36.918882 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ab1a9d01-31fa-4efd-b414-f127f879a55a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:36.919783 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ab1a9d01-31fa-4efd-b414-f127f879a55a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:37.088532 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ab1a9d01-31fa-4efd-b414-f127f879a55a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:37.096773 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ab1a9d01-31fa-4efd-b414-f127f879a55a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1317 microversion: 2.1 time: 0.191488 Aug 24 19:31:37.097719 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 162/311] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:36 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:37.234358 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-33061f62-7638-4db6-acc3-baf1e48bd831 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:37.235068 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-33061f62-7638-4db6-acc3-baf1e48bd831 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:37.241817 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-33061f62-7638-4db6-acc3-baf1e48bd831 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:37.242262 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-33061f62-7638-4db6-acc3-baf1e48bd831 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:37.243737 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-33061f62-7638-4db6-acc3-baf1e48bd831 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:37.244362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-33061f62-7638-4db6-acc3-baf1e48bd831 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:37.385149 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-33061f62-7638-4db6-acc3-baf1e48bd831 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:37.393049 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-33061f62-7638-4db6-acc3-baf1e48bd831 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.162838 Aug 24 19:31:37.393637 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 150/312] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:37 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:37.700829 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-90a952f9-dd73-4f9d-b7b3-88fc9bc11909 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:37.701816 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-90a952f9-dd73-4f9d-b7b3-88fc9bc11909 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:37.708826 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-90a952f9-dd73-4f9d-b7b3-88fc9bc11909 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:37.709316 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-90a952f9-dd73-4f9d-b7b3-88fc9bc11909 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:37.710186 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-90a952f9-dd73-4f9d-b7b3-88fc9bc11909 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:37.711309 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-90a952f9-dd73-4f9d-b7b3-88fc9bc11909 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:37.804155 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-90a952f9-dd73-4f9d-b7b3-88fc9bc11909 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 28628 microversion: 2.1 time: 0.106925 Aug 24 19:31:37.805115 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 163/313] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:37 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 28628 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:37.805930 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ea3a31fb-99e6-40f7-ae84-07eb7d9ad5bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:37.806914 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ea3a31fb-99e6-40f7-ae84-07eb7d9ad5bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:37.812731 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea3a31fb-99e6-40f7-ae84-07eb7d9ad5bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:37.813165 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea3a31fb-99e6-40f7-ae84-07eb7d9ad5bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:37.813922 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea3a31fb-99e6-40f7-ae84-07eb7d9ad5bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:37.814347 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea3a31fb-99e6-40f7-ae84-07eb7d9ad5bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:37.900977 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ea3a31fb-99e6-40f7-ae84-07eb7d9ad5bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 28561 microversion: 2.20 time: 0.099120 Aug 24 19:31:37.901647 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 151/314] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:37 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 28561 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:38.114287 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4f2c9cbd-8eea-44b5-85aa-4a96d307fd83 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:38.114892 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4f2c9cbd-8eea-44b5-85aa-4a96d307fd83 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:38.121338 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f2c9cbd-8eea-44b5-85aa-4a96d307fd83 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:38.121874 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f2c9cbd-8eea-44b5-85aa-4a96d307fd83 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:38.122628 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f2c9cbd-8eea-44b5-85aa-4a96d307fd83 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:38.123052 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f2c9cbd-8eea-44b5-85aa-4a96d307fd83 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:38.248310 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4f2c9cbd-8eea-44b5-85aa-4a96d307fd83 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:38.255679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4f2c9cbd-8eea-44b5-85aa-4a96d307fd83 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1317 microversion: 2.1 time: 0.145551 Aug 24 19:31:38.256246 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 164/315] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:38 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:38.410604 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9dac4939-9ea6-4247-b91b-b20813130ac2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:38.411243 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9dac4939-9ea6-4247-b91b-b20813130ac2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:38.417634 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9dac4939-9ea6-4247-b91b-b20813130ac2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:38.418080 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9dac4939-9ea6-4247-b91b-b20813130ac2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:38.418847 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9dac4939-9ea6-4247-b91b-b20813130ac2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:38.419275 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9dac4939-9ea6-4247-b91b-b20813130ac2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:38.568608 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9dac4939-9ea6-4247-b91b-b20813130ac2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:38.576393 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9dac4939-9ea6-4247-b91b-b20813130ac2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.170017 Aug 24 19:31:38.576941 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 152/316] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:38 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:38.820132 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-dbb7cf9e-e6dc-44ee-bd93-6c0b1e0a0e9a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:38.829421 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-dbb7cf9e-e6dc-44ee-bd93-6c0b1e0a0e9a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:38.829421 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dbb7cf9e-e6dc-44ee-bd93-6c0b1e0a0e9a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:38.829421 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dbb7cf9e-e6dc-44ee-bd93-6c0b1e0a0e9a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:38.829421 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dbb7cf9e-e6dc-44ee-bd93-6c0b1e0a0e9a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:38.829799 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dbb7cf9e-e6dc-44ee-bd93-6c0b1e0a0e9a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:38.903063 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-dbb7cf9e-e6dc-44ee-bd93-6c0b1e0a0e9a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 28628 microversion: 2.1 time: 0.090310 Aug 24 19:31:38.903830 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 165/317] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:38 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 28628 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:38.913857 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-de60867b-de61-4312-90b2-cfde82a3b8bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:38.915458 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-de60867b-de61-4312-90b2-cfde82a3b8bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:38.923667 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-de60867b-de61-4312-90b2-cfde82a3b8bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:38.924110 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-de60867b-de61-4312-90b2-cfde82a3b8bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:38.925108 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-de60867b-de61-4312-90b2-cfde82a3b8bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:38.925536 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-de60867b-de61-4312-90b2-cfde82a3b8bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:39.007526 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-de60867b-de61-4312-90b2-cfde82a3b8bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 28561 microversion: 2.20 time: 0.097245 Aug 24 19:31:39.012555 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 153/318] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:38 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 28561 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:39.273353 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8cfc179c-fa67-42a2-bf02-10f099b96b81 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:39.274076 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8cfc179c-fa67-42a2-bf02-10f099b96b81 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:39.281425 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8cfc179c-fa67-42a2-bf02-10f099b96b81 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:39.281829 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8cfc179c-fa67-42a2-bf02-10f099b96b81 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:39.282591 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8cfc179c-fa67-42a2-bf02-10f099b96b81 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:39.283025 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8cfc179c-fa67-42a2-bf02-10f099b96b81 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:39.407334 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8cfc179c-fa67-42a2-bf02-10f099b96b81 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:39.414625 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8cfc179c-fa67-42a2-bf02-10f099b96b81 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1317 microversion: 2.1 time: 0.145364 Aug 24 19:31:39.415207 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 166/319] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:39 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:39.593570 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9e9ddb12-e268-4939-8089-f69200a88cf5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:39.594527 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9e9ddb12-e268-4939-8089-f69200a88cf5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:39.601094 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9e9ddb12-e268-4939-8089-f69200a88cf5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:39.601536 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9e9ddb12-e268-4939-8089-f69200a88cf5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:39.602312 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9e9ddb12-e268-4939-8089-f69200a88cf5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:39.602742 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9e9ddb12-e268-4939-8089-f69200a88cf5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:39.749394 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9e9ddb12-e268-4939-8089-f69200a88cf5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:39.756816 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9e9ddb12-e268-4939-8089-f69200a88cf5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1521 microversion: 2.1 time: 0.167248 Aug 24 19:31:39.757368 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 154/320] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:39 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:39.916809 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-49e4fbaa-fe90-4bad-b074-b59e5b26e163 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:39.917722 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-49e4fbaa-fe90-4bad-b074-b59e5b26e163 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:39.923856 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-49e4fbaa-fe90-4bad-b074-b59e5b26e163 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:39.924346 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-49e4fbaa-fe90-4bad-b074-b59e5b26e163 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:39.925111 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-49e4fbaa-fe90-4bad-b074-b59e5b26e163 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:39.925534 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-49e4fbaa-fe90-4bad-b074-b59e5b26e163 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:40.013604 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-49e4fbaa-fe90-4bad-b074-b59e5b26e163 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 28628 microversion: 2.1 time: 0.100708 Aug 24 19:31:40.014530 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 167/321] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:39 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 28628 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:40.019009 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-cdc0d0e3-3cea-4f21-a6af-f3f1eb4f042a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:40.019920 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-cdc0d0e3-3cea-4f21-a6af-f3f1eb4f042a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:40.025749 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cdc0d0e3-3cea-4f21-a6af-f3f1eb4f042a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:40.026200 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cdc0d0e3-3cea-4f21-a6af-f3f1eb4f042a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:40.026978 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cdc0d0e3-3cea-4f21-a6af-f3f1eb4f042a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:40.027402 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cdc0d0e3-3cea-4f21-a6af-f3f1eb4f042a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:40.113438 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-cdc0d0e3-3cea-4f21-a6af-f3f1eb4f042a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 28561 microversion: 2.20 time: 0.097945 Aug 24 19:31:40.114124 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 155/322] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:40 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 28561 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:40.431780 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e534099d-a541-4afc-873d-ab1e5f1dbaf1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:40.432511 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e534099d-a541-4afc-873d-ab1e5f1dbaf1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:40.438949 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e534099d-a541-4afc-873d-ab1e5f1dbaf1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:40.439538 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e534099d-a541-4afc-873d-ab1e5f1dbaf1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:40.440334 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e534099d-a541-4afc-873d-ab1e5f1dbaf1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:40.440767 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e534099d-a541-4afc-873d-ab1e5f1dbaf1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:40.591368 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e534099d-a541-4afc-873d-ab1e5f1dbaf1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:40.600782 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e534099d-a541-4afc-873d-ab1e5f1dbaf1 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1317 microversion: 2.1 time: 0.172486 Aug 24 19:31:40.604821 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 168/323] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:40 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:40.660610 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-d121b241-0acb-4ff7-83c9-3071a13f7f98 req-cc334ace-db2b-446d-9d00-73188f94d6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554e6201-ec34-45b3-ad25-7eba945122f0", "name": "network-vif-plugged", "status": "completed", "tag": "a907cbe7-3847-4d97-9c08-0319637b734f"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:40.662228 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:31:40.662228 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:31:40.671815 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-d121b241-0acb-4ff7-83c9-3071a13f7f98 req-cc334ace-db2b-446d-9d00-73188f94d6c6 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:40.672023 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-d121b241-0acb-4ff7-83c9-3071a13f7f98 req-cc334ace-db2b-446d-9d00-73188f94d6c6 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:40.688190 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-d121b241-0acb-4ff7-83c9-3071a13f7f98 req-cc334ace-db2b-446d-9d00-73188f94d6c6 service nova] Creating event network-vif-plugged:a907cbe7-3847-4d97-9c08-0319637b734f for instance 554e6201-ec34-45b3-ad25-7eba945122f0 on hv-cinder-79819 Aug 24 19:31:40.693115 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-d121b241-0acb-4ff7-83c9-3071a13f7f98 req-cc334ace-db2b-446d-9d00-73188f94d6c6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036592 Aug 24 19:31:40.694027 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 156/324] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:31:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:31:40.773657 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-99996b49-ed4f-400c-b0b7-5dfc1721dcbd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:40.774260 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-99996b49-ed4f-400c-b0b7-5dfc1721dcbd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:40.780332 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-99996b49-ed4f-400c-b0b7-5dfc1721dcbd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:40.780777 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-99996b49-ed4f-400c-b0b7-5dfc1721dcbd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:40.781544 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-99996b49-ed4f-400c-b0b7-5dfc1721dcbd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:40.781966 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-99996b49-ed4f-400c-b0b7-5dfc1721dcbd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:40.932433 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-99996b49-ed4f-400c-b0b7-5dfc1721dcbd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:40.940289 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-99996b49-ed4f-400c-b0b7-5dfc1721dcbd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1501 microversion: 2.1 time: 0.170267 Aug 24 19:31:40.940957 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 169/325] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:40 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:40.956806 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-096bcc57-c774-474a-865e-6760ce6d3e82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:40.957493 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-096bcc57-c774-474a-865e-6760ce6d3e82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:40.964015 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-096bcc57-c774-474a-865e-6760ce6d3e82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:40.964454 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-096bcc57-c774-474a-865e-6760ce6d3e82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:40.965213 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-096bcc57-c774-474a-865e-6760ce6d3e82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:40.965640 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-096bcc57-c774-474a-865e-6760ce6d3e82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:41.026378 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-dfd6f8be-8cd2-4e22-adb5-ec3e2b228434 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:41.035773 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-dfd6f8be-8cd2-4e22-adb5-ec3e2b228434 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:41.043591 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfd6f8be-8cd2-4e22-adb5-ec3e2b228434 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:41.044312 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfd6f8be-8cd2-4e22-adb5-ec3e2b228434 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:41.045095 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfd6f8be-8cd2-4e22-adb5-ec3e2b228434 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:41.045552 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfd6f8be-8cd2-4e22-adb5-ec3e2b228434 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:41.109726 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-096bcc57-c774-474a-865e-6760ce6d3e82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:41.129464 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-dfd6f8be-8cd2-4e22-adb5-ec3e2b228434 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 28628 microversion: 2.1 time: 0.107030 Aug 24 19:31:41.133436 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 170/326] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:41 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 28628 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:41.134309 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-096bcc57-c774-474a-865e-6760ce6d3e82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1514 microversion: 2.1 time: 0.177804 Aug 24 19:31:41.134541 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 157/327] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:40 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1514 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:41.138546 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5559acac-4ba9-47a4-8a8d-5bb26b048809 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:41.139595 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5559acac-4ba9-47a4-8a8d-5bb26b048809 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:41.155119 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5559acac-4ba9-47a4-8a8d-5bb26b048809 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:41.155119 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5559acac-4ba9-47a4-8a8d-5bb26b048809 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:41.155119 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5559acac-4ba9-47a4-8a8d-5bb26b048809 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:41.155119 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5559acac-4ba9-47a4-8a8d-5bb26b048809 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:41.436095 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5559acac-4ba9-47a4-8a8d-5bb26b048809 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 28561 microversion: 2.20 time: 0.302944 Aug 24 19:31:41.437088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 171/328] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:41 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 28561 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:41.618836 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a205589c-92c2-4cf1-bcfb-d30308dfc9ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:41.619449 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a205589c-92c2-4cf1-bcfb-d30308dfc9ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:41.625347 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a205589c-92c2-4cf1-bcfb-d30308dfc9ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:41.625775 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a205589c-92c2-4cf1-bcfb-d30308dfc9ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:41.626535 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a205589c-92c2-4cf1-bcfb-d30308dfc9ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:41.626962 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a205589c-92c2-4cf1-bcfb-d30308dfc9ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:41.749110 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a205589c-92c2-4cf1-bcfb-d30308dfc9ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:41.764890 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a205589c-92c2-4cf1-bcfb-d30308dfc9ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1317 microversion: 2.1 time: 0.150234 Aug 24 19:31:41.765460 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 158/329] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:41 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:42.141573 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-07ee8019-dd3b-4aee-9d24-85ecdc583b10 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:42.142796 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-07ee8019-dd3b-4aee-9d24-85ecdc583b10 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:42.157773 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-07ee8019-dd3b-4aee-9d24-85ecdc583b10 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:42.157773 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-07ee8019-dd3b-4aee-9d24-85ecdc583b10 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:42.157773 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-07ee8019-dd3b-4aee-9d24-85ecdc583b10 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:42.157773 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-07ee8019-dd3b-4aee-9d24-85ecdc583b10 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:42.448421 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-bd3ff93e-b0f9-4d81-8055-28323598977e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:42.449373 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-bd3ff93e-b0f9-4d81-8055-28323598977e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:42.455269 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bd3ff93e-b0f9-4d81-8055-28323598977e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:42.455694 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bd3ff93e-b0f9-4d81-8055-28323598977e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:42.456480 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bd3ff93e-b0f9-4d81-8055-28323598977e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:42.456943 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bd3ff93e-b0f9-4d81-8055-28323598977e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:45.020175 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-07ee8019-dd3b-4aee-9d24-85ecdc583b10 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 28628 microversion: 2.1 time: 2.882591 Aug 24 19:31:45.021185 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 172/330] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:42 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 28628 bytes in 2885 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:45.027556 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-36cb3523-cbd7-488e-a510-34736539ca05 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:45.028289 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-36cb3523-cbd7-488e-a510-34736539ca05 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:45.031000 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-bd3ff93e-b0f9-4d81-8055-28323598977e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 28561 microversion: 2.20 time: 2.586866 Aug 24 19:31:45.032167 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 159/331] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:42 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 28561 bytes in 2589 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:45.034739 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-36cb3523-cbd7-488e-a510-34736539ca05 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:45.035176 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-36cb3523-cbd7-488e-a510-34736539ca05 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:45.036527 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-36cb3523-cbd7-488e-a510-34736539ca05 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:45.036959 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-36cb3523-cbd7-488e-a510-34736539ca05 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:45.160440 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-36cb3523-cbd7-488e-a510-34736539ca05 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:45.168056 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-36cb3523-cbd7-488e-a510-34736539ca05 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1317 microversion: 2.1 time: 0.145660 Aug 24 19:31:45.168689 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 173/332] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:45 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:46.033129 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a066dbd5-1816-4a6f-bd48-01397ca6d74f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:46.034119 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a066dbd5-1816-4a6f-bd48-01397ca6d74f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:46.040821 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a066dbd5-1816-4a6f-bd48-01397ca6d74f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:46.041193 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a066dbd5-1816-4a6f-bd48-01397ca6d74f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:46.042621 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a066dbd5-1816-4a6f-bd48-01397ca6d74f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:46.043098 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a066dbd5-1816-4a6f-bd48-01397ca6d74f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:46.043865 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-213d33d8-3b61-4ef3-b5eb-ac14e5ad36ee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:46.044873 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-213d33d8-3b61-4ef3-b5eb-ac14e5ad36ee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:46.051767 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-213d33d8-3b61-4ef3-b5eb-ac14e5ad36ee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:46.052227 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-213d33d8-3b61-4ef3-b5eb-ac14e5ad36ee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:46.053207 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-213d33d8-3b61-4ef3-b5eb-ac14e5ad36ee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:46.053643 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-213d33d8-3b61-4ef3-b5eb-ac14e5ad36ee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:46.127408 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a066dbd5-1816-4a6f-bd48-01397ca6d74f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 28628 microversion: 2.1 time: 0.098030 Aug 24 19:31:46.131445 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 160/333] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:46 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 28628 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:46.139387 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-213d33d8-3b61-4ef3-b5eb-ac14e5ad36ee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 28561 microversion: 2.20 time: 0.099873 Aug 24 19:31:46.140335 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 174/334] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:46 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 28561 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:46.185471 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ac2ee7ce-968c-4e1f-a598-51705ad1b15c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:46.186182 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ac2ee7ce-968c-4e1f-a598-51705ad1b15c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:46.192680 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ac2ee7ce-968c-4e1f-a598-51705ad1b15c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:46.193134 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ac2ee7ce-968c-4e1f-a598-51705ad1b15c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:46.193897 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ac2ee7ce-968c-4e1f-a598-51705ad1b15c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:46.194404 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ac2ee7ce-968c-4e1f-a598-51705ad1b15c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:46.317139 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ac2ee7ce-968c-4e1f-a598-51705ad1b15c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:46.325093 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ac2ee7ce-968c-4e1f-a598-51705ad1b15c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1506 microversion: 2.1 time: 0.143647 Aug 24 19:31:46.333101 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 161/335] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:46 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1506 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:46.556886 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1ccbc061-9b14-4db9-a6ab-deedcd7735b0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:46.558612 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1ccbc061-9b14-4db9-a6ab-deedcd7735b0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:46.568845 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1ccbc061-9b14-4db9-a6ab-deedcd7735b0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:46.569468 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1ccbc061-9b14-4db9-a6ab-deedcd7735b0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:46.570425 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1ccbc061-9b14-4db9-a6ab-deedcd7735b0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:46.571002 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1ccbc061-9b14-4db9-a6ab-deedcd7735b0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:46.594346 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.objects.instance [None req-1ccbc061-9b14-4db9-a6ab-deedcd7735b0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lazy-loading 'flavor' on Instance uuid 649b4ff1-abbd-4ccb-8b5a-9ba24f560372 {{(pid=108908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:31:47.139099 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-37c39824-650d-46c2-ae4a-30b73288a2c8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:47.140011 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-37c39824-650d-46c2-ae4a-30b73288a2c8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:47.147745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-37c39824-650d-46c2-ae4a-30b73288a2c8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:47.147745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-37c39824-650d-46c2-ae4a-30b73288a2c8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:47.147907 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-37c39824-650d-46c2-ae4a-30b73288a2c8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:47.148378 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-37c39824-650d-46c2-ae4a-30b73288a2c8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:47.222456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1ccbc061-9b14-4db9-a6ab-deedcd7735b0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "POST /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/action" status: 200 len: 32 microversion: 2.1 time: 0.668419 Aug 24 19:31:47.222456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 175/336] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:46 2021] POST /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/action => generated 32 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:31:47.231471 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ebebea5b-01b9-4204-8869-0d819e72c203 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:47.231471 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ebebea5b-01b9-4204-8869-0d819e72c203 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:47.235238 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ebebea5b-01b9-4204-8869-0d819e72c203 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:47.235689 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ebebea5b-01b9-4204-8869-0d819e72c203 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:47.236490 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ebebea5b-01b9-4204-8869-0d819e72c203 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:47.236913 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ebebea5b-01b9-4204-8869-0d819e72c203 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:47.249363 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-37c39824-650d-46c2-ae4a-30b73288a2c8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 28628 microversion: 2.1 time: 0.113912 Aug 24 19:31:47.250542 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 162/337] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:47 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 28628 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:31:47.255799 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-02be07a4-0367-4fe5-b696-2486b9dc873a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:47.256876 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-02be07a4-0367-4fe5-b696-2486b9dc873a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:47.264805 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-02be07a4-0367-4fe5-b696-2486b9dc873a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:47.265731 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-02be07a4-0367-4fe5-b696-2486b9dc873a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:47.266508 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-02be07a4-0367-4fe5-b696-2486b9dc873a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:47.267281 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-02be07a4-0367-4fe5-b696-2486b9dc873a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:47.334881 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ebebea5b-01b9-4204-8869-0d819e72c203 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 28561 microversion: 2.20 time: 0.110920 Aug 24 19:31:47.340339 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 176/338] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:47 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 28561 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:47.454344 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-02be07a4-0367-4fe5-b696-2486b9dc873a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:47.462468 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-02be07a4-0367-4fe5-b696-2486b9dc873a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.210630 Aug 24 19:31:47.463165 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 163/339] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:47 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:48.266829 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-854e5a9f-d973-4385-83a8-2db660a8502a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:48.267818 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-854e5a9f-d973-4385-83a8-2db660a8502a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:48.274733 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-854e5a9f-d973-4385-83a8-2db660a8502a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:48.275179 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-854e5a9f-d973-4385-83a8-2db660a8502a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:48.275973 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-854e5a9f-d973-4385-83a8-2db660a8502a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:48.276434 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-854e5a9f-d973-4385-83a8-2db660a8502a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:48.346646 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-62db42d0-fecd-4cbc-aa94-b861ec3df31c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:48.347544 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-62db42d0-fecd-4cbc-aa94-b861ec3df31c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:48.354477 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-62db42d0-fecd-4cbc-aa94-b861ec3df31c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:48.355474 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-62db42d0-fecd-4cbc-aa94-b861ec3df31c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:48.356245 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-62db42d0-fecd-4cbc-aa94-b861ec3df31c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:48.358379 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-62db42d0-fecd-4cbc-aa94-b861ec3df31c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:48.358978 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-854e5a9f-d973-4385-83a8-2db660a8502a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 28628 microversion: 2.1 time: 0.096144 Aug 24 19:31:48.359847 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 177/340] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:48 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 28628 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:48.444643 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-62db42d0-fecd-4cbc-aa94-b861ec3df31c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 28561 microversion: 2.20 time: 0.100961 Aug 24 19:31:48.446086 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 164/341] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:48 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 28561 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:48.479799 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e694a3de-1cdc-48e7-b81c-140ca0da73d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:48.480512 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e694a3de-1cdc-48e7-b81c-140ca0da73d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:48.487319 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e694a3de-1cdc-48e7-b81c-140ca0da73d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:48.487985 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e694a3de-1cdc-48e7-b81c-140ca0da73d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:48.488954 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e694a3de-1cdc-48e7-b81c-140ca0da73d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:48.489361 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e694a3de-1cdc-48e7-b81c-140ca0da73d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:48.495682 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f6d3ff03-8357-4f8f-8cce-cb2c760ca8a7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "584b4bbd-75a3-4ecf-81a8-d9cb87e28dd6"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:48.497243 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f6d3ff03-8357-4f8f-8cce-cb2c760ca8a7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:48.504287 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f6d3ff03-8357-4f8f-8cce-cb2c760ca8a7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:48.504854 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f6d3ff03-8357-4f8f-8cce-cb2c760ca8a7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:48.505842 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f6d3ff03-8357-4f8f-8cce-cb2c760ca8a7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:48.506279 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f6d3ff03-8357-4f8f-8cce-cb2c760ca8a7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:48.635936 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e694a3de-1cdc-48e7-b81c-140ca0da73d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:48.643466 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e694a3de-1cdc-48e7-b81c-140ca0da73d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.168281 Aug 24 19:31:48.644034 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 178/342] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:48 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:49.370685 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-64101fa0-d5d9-4f39-852b-e37b45879579 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:49.371647 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-64101fa0-d5d9-4f39-852b-e37b45879579 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:49.377814 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-64101fa0-d5d9-4f39-852b-e37b45879579 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:49.378403 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-64101fa0-d5d9-4f39-852b-e37b45879579 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:49.379182 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-64101fa0-d5d9-4f39-852b-e37b45879579 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:49.379615 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-64101fa0-d5d9-4f39-852b-e37b45879579 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:49.452564 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-64101fa0-d5d9-4f39-852b-e37b45879579 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 28628 microversion: 2.1 time: 0.086016 Aug 24 19:31:49.453316 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 179/343] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:49 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 28628 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:31:49.458784 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5d5b85ce-1623-4336-9740-5755f5711f84 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:49.459837 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5d5b85ce-1623-4336-9740-5755f5711f84 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:49.466579 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5d5b85ce-1623-4336-9740-5755f5711f84 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:49.467027 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5d5b85ce-1623-4336-9740-5755f5711f84 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:49.467893 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5d5b85ce-1623-4336-9740-5755f5711f84 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:49.468351 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5d5b85ce-1623-4336-9740-5755f5711f84 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:49.548684 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5d5b85ce-1623-4336-9740-5755f5711f84 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 28561 microversion: 2.20 time: 0.093601 Aug 24 19:31:49.549341 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 180/344] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:49 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 28561 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:49.661196 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e0219e2d-e2a1-40b4-9963-ad9c23e295c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:49.661991 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e0219e2d-e2a1-40b4-9963-ad9c23e295c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:49.669118 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e0219e2d-e2a1-40b4-9963-ad9c23e295c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:49.669562 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e0219e2d-e2a1-40b4-9963-ad9c23e295c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:49.670584 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e0219e2d-e2a1-40b4-9963-ad9c23e295c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:49.671010 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e0219e2d-e2a1-40b4-9963-ad9c23e295c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:49.813429 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e0219e2d-e2a1-40b4-9963-ad9c23e295c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:49.821733 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e0219e2d-e2a1-40b4-9963-ad9c23e295c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.164690 Aug 24 19:31:49.834203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 181/345] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:49 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:49.834432 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f6d3ff03-8357-4f8f-8cce-cb2c760ca8a7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "POST /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.336137 Aug 24 19:31:49.834432 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 165/346] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 24 19:31:48 2021] POST /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0/os-volume_attachments => generated 194 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:31:50.465158 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6fbfd8cd-5707-47c7-8310-faa2ca80e314 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:50.466082 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6fbfd8cd-5707-47c7-8310-faa2ca80e314 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:50.471855 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6fbfd8cd-5707-47c7-8310-faa2ca80e314 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:50.472332 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6fbfd8cd-5707-47c7-8310-faa2ca80e314 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:50.473099 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6fbfd8cd-5707-47c7-8310-faa2ca80e314 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:50.473532 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6fbfd8cd-5707-47c7-8310-faa2ca80e314 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:50.563582 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f4d3a7fc-b9e9-47c7-a570-baf3a76cebbd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:50.564636 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f4d3a7fc-b9e9-47c7-a570-baf3a76cebbd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:50.573090 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f4d3a7fc-b9e9-47c7-a570-baf3a76cebbd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:50.573662 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f4d3a7fc-b9e9-47c7-a570-baf3a76cebbd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:50.574467 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f4d3a7fc-b9e9-47c7-a570-baf3a76cebbd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:50.574927 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f4d3a7fc-b9e9-47c7-a570-baf3a76cebbd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:50.578253 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6fbfd8cd-5707-47c7-8310-faa2ca80e314 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 29595 microversion: 2.1 time: 0.117155 Aug 24 19:31:50.578924 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 182/347] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:50 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 29595 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:50.665638 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f4d3a7fc-b9e9-47c7-a570-baf3a76cebbd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 28760 microversion: 2.20 time: 0.106448 Aug 24 19:31:50.666312 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 166/348] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:50 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 28760 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:50.841733 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8a876d45-0779-4a7c-ab99-0f972af9cb61 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:50.842429 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8a876d45-0779-4a7c-ab99-0f972af9cb61 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:50.848961 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8a876d45-0779-4a7c-ab99-0f972af9cb61 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:50.849435 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8a876d45-0779-4a7c-ab99-0f972af9cb61 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:50.850208 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8a876d45-0779-4a7c-ab99-0f972af9cb61 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:50.850644 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8a876d45-0779-4a7c-ab99-0f972af9cb61 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:50.979179 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8a876d45-0779-4a7c-ab99-0f972af9cb61 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:50.987183 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8a876d45-0779-4a7c-ab99-0f972af9cb61 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.149369 Aug 24 19:31:50.987842 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 183/349] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:50 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:51.591124 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-eb37950b-ff1e-4477-bf10-25565ff42f99 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:51.592020 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-eb37950b-ff1e-4477-bf10-25565ff42f99 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:51.598578 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eb37950b-ff1e-4477-bf10-25565ff42f99 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:51.599007 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eb37950b-ff1e-4477-bf10-25565ff42f99 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:51.599762 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eb37950b-ff1e-4477-bf10-25565ff42f99 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:51.600184 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eb37950b-ff1e-4477-bf10-25565ff42f99 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:51.677993 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-121299b1-381d-4b22-8435-68e553c99d7b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:51.679004 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-121299b1-381d-4b22-8435-68e553c99d7b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:51.684824 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-121299b1-381d-4b22-8435-68e553c99d7b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:51.685262 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-121299b1-381d-4b22-8435-68e553c99d7b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:51.686039 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-121299b1-381d-4b22-8435-68e553c99d7b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:51.686448 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-121299b1-381d-4b22-8435-68e553c99d7b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:51.693916 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-eb37950b-ff1e-4477-bf10-25565ff42f99 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 30659 microversion: 2.1 time: 0.107172 Aug 24 19:31:51.698392 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 167/350] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:51 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 30659 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:51.775810 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-121299b1-381d-4b22-8435-68e553c99d7b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 30000 microversion: 2.20 time: 0.099788 Aug 24 19:31:51.775810 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 184/351] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:51 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 30000 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:52.005601 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-66a369d1-26eb-41ca-b013-3494cad8ee00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:52.006504 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-66a369d1-26eb-41ca-b013-3494cad8ee00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:52.013794 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-66a369d1-26eb-41ca-b013-3494cad8ee00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:52.014240 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-66a369d1-26eb-41ca-b013-3494cad8ee00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:52.015007 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-66a369d1-26eb-41ca-b013-3494cad8ee00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:52.015426 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-66a369d1-26eb-41ca-b013-3494cad8ee00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:52.186044 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-66a369d1-26eb-41ca-b013-3494cad8ee00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:52.191844 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-66a369d1-26eb-41ca-b013-3494cad8ee00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.190506 Aug 24 19:31:52.200519 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 168/352] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:51 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:52.706699 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-18f53584-87b5-4160-8cc9-42e18d160a8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:52.711839 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-18f53584-87b5-4160-8cc9-42e18d160a8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:52.714275 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-18f53584-87b5-4160-8cc9-42e18d160a8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:52.714726 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-18f53584-87b5-4160-8cc9-42e18d160a8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:52.715498 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-18f53584-87b5-4160-8cc9-42e18d160a8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:52.715928 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-18f53584-87b5-4160-8cc9-42e18d160a8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:52.787441 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c90e8bf5-ae54-4950-9ec5-c027deddfefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:52.788561 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c90e8bf5-ae54-4950-9ec5-c027deddfefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:52.795860 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c90e8bf5-ae54-4950-9ec5-c027deddfefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:52.795982 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c90e8bf5-ae54-4950-9ec5-c027deddfefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:52.796778 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c90e8bf5-ae54-4950-9ec5-c027deddfefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:52.797220 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c90e8bf5-ae54-4950-9ec5-c027deddfefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:52.814824 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-18f53584-87b5-4160-8cc9-42e18d160a8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 31786 microversion: 2.1 time: 0.112013 Aug 24 19:31:52.816046 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 185/353] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:52 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 31786 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:31:52.900950 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c90e8bf5-ae54-4950-9ec5-c027deddfefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 31413 microversion: 2.20 time: 0.116274 Aug 24 19:31:52.904309 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 169/354] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:52 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 31413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:53.209708 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4218cb0c-e3d0-4ad6-bbfb-ee55fbd1c09a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:53.210669 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4218cb0c-e3d0-4ad6-bbfb-ee55fbd1c09a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:53.217242 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4218cb0c-e3d0-4ad6-bbfb-ee55fbd1c09a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:53.224983 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4218cb0c-e3d0-4ad6-bbfb-ee55fbd1c09a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:53.224983 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4218cb0c-e3d0-4ad6-bbfb-ee55fbd1c09a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:53.224983 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4218cb0c-e3d0-4ad6-bbfb-ee55fbd1c09a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:53.377682 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4218cb0c-e3d0-4ad6-bbfb-ee55fbd1c09a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:53.385500 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4218cb0c-e3d0-4ad6-bbfb-ee55fbd1c09a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.179776 Aug 24 19:31:53.386252 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 186/355] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:53 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:53.827779 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-81e075d6-35a1-463e-a5e7-bcf8946630aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:53.828714 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-81e075d6-35a1-463e-a5e7-bcf8946630aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:53.835779 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-81e075d6-35a1-463e-a5e7-bcf8946630aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:53.836347 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-81e075d6-35a1-463e-a5e7-bcf8946630aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:53.838615 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-81e075d6-35a1-463e-a5e7-bcf8946630aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:53.839488 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-81e075d6-35a1-463e-a5e7-bcf8946630aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:53.912514 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-efdd7163-5225-4d40-9ea2-e46a2afe7368 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:53.913450 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-efdd7163-5225-4d40-9ea2-e46a2afe7368 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:53.926811 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-efdd7163-5225-4d40-9ea2-e46a2afe7368 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:53.927262 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-efdd7163-5225-4d40-9ea2-e46a2afe7368 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:53.928555 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-efdd7163-5225-4d40-9ea2-e46a2afe7368 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:53.928883 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-efdd7163-5225-4d40-9ea2-e46a2afe7368 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:53.934744 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-81e075d6-35a1-463e-a5e7-bcf8946630aa tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 32828 microversion: 2.1 time: 0.110968 Aug 24 19:31:53.936120 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 170/356] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:53 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 32828 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:54.037269 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-efdd7163-5225-4d40-9ea2-e46a2afe7368 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 32119 microversion: 2.20 time: 0.128099 Aug 24 19:31:54.037838 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 187/357] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:53 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 32119 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:31:54.404650 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-db100506-df93-4db2-95a1-231a0125d05e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:54.405571 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-db100506-df93-4db2-95a1-231a0125d05e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:54.412052 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-db100506-df93-4db2-95a1-231a0125d05e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:54.412604 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-db100506-df93-4db2-95a1-231a0125d05e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:54.413430 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-db100506-df93-4db2-95a1-231a0125d05e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:54.413924 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-db100506-df93-4db2-95a1-231a0125d05e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:54.534946 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-db100506-df93-4db2-95a1-231a0125d05e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:54.543412 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-db100506-df93-4db2-95a1-231a0125d05e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.143370 Aug 24 19:31:54.553090 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 171/358] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:54 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:54.947395 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2fabbc3b-ff17-4087-a37f-31cb9b07fc62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:54.948411 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2fabbc3b-ff17-4087-a37f-31cb9b07fc62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:54.954859 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2fabbc3b-ff17-4087-a37f-31cb9b07fc62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:54.956703 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2fabbc3b-ff17-4087-a37f-31cb9b07fc62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:54.956703 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2fabbc3b-ff17-4087-a37f-31cb9b07fc62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:54.956703 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2fabbc3b-ff17-4087-a37f-31cb9b07fc62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:55.045031 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2fabbc3b-ff17-4087-a37f-31cb9b07fc62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 33282 microversion: 2.1 time: 0.100919 Aug 24 19:31:55.046620 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 188/359] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:54 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 33282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:55.053327 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-16d0f126-41f2-4af9-a282-ff8fe11fc0af tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:55.056757 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-16d0f126-41f2-4af9-a282-ff8fe11fc0af tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:55.063255 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-16d0f126-41f2-4af9-a282-ff8fe11fc0af tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:55.064577 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-16d0f126-41f2-4af9-a282-ff8fe11fc0af tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:55.065961 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-16d0f126-41f2-4af9-a282-ff8fe11fc0af tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:55.066692 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-16d0f126-41f2-4af9-a282-ff8fe11fc0af tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:55.177186 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-16d0f126-41f2-4af9-a282-ff8fe11fc0af tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 32737 microversion: 2.20 time: 0.129107 Aug 24 19:31:55.177951 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 172/360] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:55 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 32737 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:55.560973 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e51aaaee-32d6-4fc5-a421-24a5e46cf6c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:55.561660 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e51aaaee-32d6-4fc5-a421-24a5e46cf6c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:55.568423 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e51aaaee-32d6-4fc5-a421-24a5e46cf6c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:55.568869 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e51aaaee-32d6-4fc5-a421-24a5e46cf6c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:55.569634 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e51aaaee-32d6-4fc5-a421-24a5e46cf6c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:55.570141 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e51aaaee-32d6-4fc5-a421-24a5e46cf6c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:55.691335 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e51aaaee-32d6-4fc5-a421-24a5e46cf6c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:55.698763 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e51aaaee-32d6-4fc5-a421-24a5e46cf6c5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.141691 Aug 24 19:31:55.699381 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 189/361] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:55 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:56.059553 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8f6e0e86-ea93-4342-ad73-35d4f2d37c4a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:56.060669 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8f6e0e86-ea93-4342-ad73-35d4f2d37c4a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:56.067598 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f6e0e86-ea93-4342-ad73-35d4f2d37c4a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:56.068379 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f6e0e86-ea93-4342-ad73-35d4f2d37c4a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:56.069332 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f6e0e86-ea93-4342-ad73-35d4f2d37c4a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:56.074507 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f6e0e86-ea93-4342-ad73-35d4f2d37c4a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:56.172731 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8f6e0e86-ea93-4342-ad73-35d4f2d37c4a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 33739 microversion: 2.1 time: 0.118577 Aug 24 19:31:56.174592 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 173/362] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:56 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 33739 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:56.194076 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e790c2ec-405d-4e83-ba79-a5f9a5cd0ca4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:56.198007 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e790c2ec-405d-4e83-ba79-a5f9a5cd0ca4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:56.210322 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e790c2ec-405d-4e83-ba79-a5f9a5cd0ca4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:56.213641 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e790c2ec-405d-4e83-ba79-a5f9a5cd0ca4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:56.215116 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e790c2ec-405d-4e83-ba79-a5f9a5cd0ca4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:56.216700 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e790c2ec-405d-4e83-ba79-a5f9a5cd0ca4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:56.365830 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e790c2ec-405d-4e83-ba79-a5f9a5cd0ca4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 33414 microversion: 2.20 time: 0.170632 Aug 24 19:31:56.365830 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 190/363] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:56 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 33414 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:56.716539 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-28abfcca-648f-4bb9-8c0f-f720c222bccc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:56.717234 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-28abfcca-648f-4bb9-8c0f-f720c222bccc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:56.723960 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-28abfcca-648f-4bb9-8c0f-f720c222bccc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:56.724446 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-28abfcca-648f-4bb9-8c0f-f720c222bccc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:56.725222 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-28abfcca-648f-4bb9-8c0f-f720c222bccc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:56.725669 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-28abfcca-648f-4bb9-8c0f-f720c222bccc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:56.862352 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-28abfcca-648f-4bb9-8c0f-f720c222bccc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:56.873290 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-28abfcca-648f-4bb9-8c0f-f720c222bccc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.161327 Aug 24 19:31:56.873885 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 174/364] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:56 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:57.184902 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-cac6a93f-f64d-4917-b280-e2d273384b3d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:57.185903 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-cac6a93f-f64d-4917-b280-e2d273384b3d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:57.192330 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cac6a93f-f64d-4917-b280-e2d273384b3d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:57.192782 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cac6a93f-f64d-4917-b280-e2d273384b3d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:57.193552 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cac6a93f-f64d-4917-b280-e2d273384b3d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:57.193986 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cac6a93f-f64d-4917-b280-e2d273384b3d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:57.299380 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-cac6a93f-f64d-4917-b280-e2d273384b3d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 34218 microversion: 2.1 time: 0.118426 Aug 24 19:31:57.306582 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 191/365] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:57 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 34218 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:57.368088 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f123329e-5076-4b5e-898f-0b401a2b048c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:57.369087 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f123329e-5076-4b5e-898f-0b401a2b048c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:57.376191 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f123329e-5076-4b5e-898f-0b401a2b048c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:57.377003 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f123329e-5076-4b5e-898f-0b401a2b048c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:57.378276 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f123329e-5076-4b5e-898f-0b401a2b048c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:57.378993 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f123329e-5076-4b5e-898f-0b401a2b048c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:57.477104 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f123329e-5076-4b5e-898f-0b401a2b048c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 34165 microversion: 2.20 time: 0.112773 Aug 24 19:31:57.478980 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 175/366] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:57 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 34165 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:57.931981 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6263d72f-77c5-4269-a1c6-8976917d9410 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:57.932297 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6263d72f-77c5-4269-a1c6-8976917d9410 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:57.939482 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6263d72f-77c5-4269-a1c6-8976917d9410 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:57.940297 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6263d72f-77c5-4269-a1c6-8976917d9410 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:57.941237 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6263d72f-77c5-4269-a1c6-8976917d9410 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:57.941824 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6263d72f-77c5-4269-a1c6-8976917d9410 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:58.120966 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6263d72f-77c5-4269-a1c6-8976917d9410 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:58.126736 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6263d72f-77c5-4269-a1c6-8976917d9410 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.200176 Aug 24 19:31:58.127424 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 192/367] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:57 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:31:58.319009 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-29ee50f3-864f-4ce4-b66b-0f32829d00c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:58.319009 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-29ee50f3-864f-4ce4-b66b-0f32829d00c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:58.326342 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-29ee50f3-864f-4ce4-b66b-0f32829d00c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:58.326881 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-29ee50f3-864f-4ce4-b66b-0f32829d00c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:58.327618 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-29ee50f3-864f-4ce4-b66b-0f32829d00c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:58.328030 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-29ee50f3-864f-4ce4-b66b-0f32829d00c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:58.419223 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-29ee50f3-864f-4ce4-b66b-0f32829d00c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 34935 microversion: 2.1 time: 0.110665 Aug 24 19:31:58.421719 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 176/368] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:58 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 34935 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:58.491352 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ae25b8a4-dae1-4dd8-a983-25e71097b5d9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:58.492554 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ae25b8a4-dae1-4dd8-a983-25e71097b5d9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:58.498666 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ae25b8a4-dae1-4dd8-a983-25e71097b5d9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:58.499380 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ae25b8a4-dae1-4dd8-a983-25e71097b5d9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:58.500496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ae25b8a4-dae1-4dd8-a983-25e71097b5d9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:58.501118 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ae25b8a4-dae1-4dd8-a983-25e71097b5d9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:58.611696 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ae25b8a4-dae1-4dd8-a983-25e71097b5d9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 35040 microversion: 2.20 time: 0.124252 Aug 24 19:31:58.612571 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 193/369] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:58 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 35040 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:58.725695 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a7488491-0d51-4b8a-99e1-1b51f4571b36 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "584b4bbd-75a3-4ecf-81a8-d9cb87e28dd6"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:58.726826 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a7488491-0d51-4b8a-99e1-1b51f4571b36 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:58.734123 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a7488491-0d51-4b8a-99e1-1b51f4571b36 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:58.734570 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a7488491-0d51-4b8a-99e1-1b51f4571b36 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:58.735335 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a7488491-0d51-4b8a-99e1-1b51f4571b36 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:58.735761 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a7488491-0d51-4b8a-99e1-1b51f4571b36 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:58.818816 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-a7488491-0d51-4b8a-99e1-1b51f4571b36 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] HTTP exception thrown: Invalid volume: volume 584b4bbd-75a3-4ecf-81a8-d9cb87e28dd6 is already attached to instances: 554e6201-ec34-45b3-ad25-7eba945122f0 Aug 24 19:31:58.820133 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a7488491-0d51-4b8a-99e1-1b51f4571b36 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Returning 400 to user: Invalid volume: volume 584b4bbd-75a3-4ecf-81a8-d9cb87e28dd6 is already attached to instances: 554e6201-ec34-45b3-ad25-7eba945122f0 {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:31:58.820340 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a7488491-0d51-4b8a-99e1-1b51f4571b36 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "POST /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098891 Aug 24 19:31:58.820881 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 177/370] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 24 19:31:58 2021] POST /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 19:31:58.889635 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f13dc976-967c-4966-acfc-fc07a063ab80 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:58.890176 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f13dc976-967c-4966-acfc-fc07a063ab80 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:58.896830 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f13dc976-967c-4966-acfc-fc07a063ab80 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:58.897203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f13dc976-967c-4966-acfc-fc07a063ab80 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:58.897982 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f13dc976-967c-4966-acfc-fc07a063ab80 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:58.898413 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f13dc976-967c-4966-acfc-fc07a063ab80 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:58.987616 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.objects.instance [None req-f13dc976-967c-4966-acfc-fc07a063ab80 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lazy-loading 'services' on Instance uuid 554e6201-ec34-45b3-ad25-7eba945122f0 {{(pid=108908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:31:59.143316 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-19bc8439-5939-42c4-88f6-deb12fba84b9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:59.144420 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-19bc8439-5939-42c4-88f6-deb12fba84b9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:59.153274 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-19bc8439-5939-42c4-88f6-deb12fba84b9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:59.153720 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-19bc8439-5939-42c4-88f6-deb12fba84b9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:59.154478 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-19bc8439-5939-42c4-88f6-deb12fba84b9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:59.154898 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-19bc8439-5939-42c4-88f6-deb12fba84b9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:59.281573 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-19bc8439-5939-42c4-88f6-deb12fba84b9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:31:59.286631 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-19bc8439-5939-42c4-88f6-deb12fba84b9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.147408 Aug 24 19:31:59.287185 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 178/371] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:31:59 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:31:59.323283 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f13dc976-967c-4966-acfc-fc07a063ab80 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "DELETE /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0/os-volume_attachments/584b4bbd-75a3-4ecf-81a8-d9cb87e28dd6" status: 202 len: 0 microversion: 2.1 time: 0.437621 Aug 24 19:31:59.324013 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 194/372] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 24 19:31:58 2021] DELETE /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0/os-volume_attachments/584b4bbd-75a3-4ecf-81a8-d9cb87e28dd6 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:31:59.340686 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9b0a4acb-aa33-4419-9bbd-9f96f0935eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:31:59.341774 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9b0a4acb-aa33-4419-9bbd-9f96f0935eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:59.347562 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9b0a4acb-aa33-4419-9bbd-9f96f0935eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:59.347995 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9b0a4acb-aa33-4419-9bbd-9f96f0935eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:59.348780 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9b0a4acb-aa33-4419-9bbd-9f96f0935eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:59.349202 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9b0a4acb-aa33-4419-9bbd-9f96f0935eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:59.377612 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9b0a4acb-aa33-4419-9bbd-9f96f0935eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041426 Aug 24 19:31:59.378153 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 179/373] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:31:59 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:31:59.431370 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-14bb4905-4364-4402-9b52-f9699570a35b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:59.432441 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-14bb4905-4364-4402-9b52-f9699570a35b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:59.438599 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-14bb4905-4364-4402-9b52-f9699570a35b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:59.439041 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-14bb4905-4364-4402-9b52-f9699570a35b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:59.439796 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-14bb4905-4364-4402-9b52-f9699570a35b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:59.440220 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-14bb4905-4364-4402-9b52-f9699570a35b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:59.520511 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-14bb4905-4364-4402-9b52-f9699570a35b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 35674 microversion: 2.1 time: 0.092821 Aug 24 19:31:59.525637 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 195/374] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:31:59 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 35674 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:31:59.629831 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6be4f8b2-107c-4fe1-89d4-052a500b1b60 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:31:59.630882 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6be4f8b2-107c-4fe1-89d4-052a500b1b60 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:31:59.637832 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6be4f8b2-107c-4fe1-89d4-052a500b1b60 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:59.638438 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6be4f8b2-107c-4fe1-89d4-052a500b1b60 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:59.644169 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6be4f8b2-107c-4fe1-89d4-052a500b1b60 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:31:59.644169 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6be4f8b2-107c-4fe1-89d4-052a500b1b60 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:31:59.738220 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6be4f8b2-107c-4fe1-89d4-052a500b1b60 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 35829 microversion: 2.20 time: 0.111990 Aug 24 19:31:59.742360 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 180/375] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:31:59 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 35829 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:32:00.310138 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-72da234c-b2a1-428b-b517-6dd005ae898f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:00.310887 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-72da234c-b2a1-428b-b517-6dd005ae898f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:00.320491 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-72da234c-b2a1-428b-b517-6dd005ae898f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:00.321444 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-72da234c-b2a1-428b-b517-6dd005ae898f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:00.322268 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-72da234c-b2a1-428b-b517-6dd005ae898f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:00.322720 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-72da234c-b2a1-428b-b517-6dd005ae898f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:00.390540 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7dfa34f3-d575-4b3f-aa93-e541b81923d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:00.391612 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7dfa34f3-d575-4b3f-aa93-e541b81923d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:00.398597 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7dfa34f3-d575-4b3f-aa93-e541b81923d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:00.399032 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7dfa34f3-d575-4b3f-aa93-e541b81923d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:00.399798 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7dfa34f3-d575-4b3f-aa93-e541b81923d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:00.400221 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7dfa34f3-d575-4b3f-aa93-e541b81923d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:00.431819 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7dfa34f3-d575-4b3f-aa93-e541b81923d8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045534 Aug 24 19:32:00.432400 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 181/376] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:32:00 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:32:00.446930 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-72da234c-b2a1-428b-b517-6dd005ae898f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:00.454418 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-72da234c-b2a1-428b-b517-6dd005ae898f tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.152411 Aug 24 19:32:00.454979 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 196/377] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:00 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:00.533392 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-2718f871-afe8-43e5-855b-8a1809f96edc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:00.534503 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-2718f871-afe8-43e5-855b-8a1809f96edc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:00.541002 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2718f871-afe8-43e5-855b-8a1809f96edc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:00.541448 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2718f871-afe8-43e5-855b-8a1809f96edc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:00.542247 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2718f871-afe8-43e5-855b-8a1809f96edc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:00.542851 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2718f871-afe8-43e5-855b-8a1809f96edc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:00.648150 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-2718f871-afe8-43e5-855b-8a1809f96edc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 36690 microversion: 2.1 time: 0.118787 Aug 24 19:32:00.648890 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 182/378] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:32:00 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 36690 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:32:00.749977 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ef0f9166-8821-4c0d-a6d6-02ca92d93e6f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:00.750976 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ef0f9166-8821-4c0d-a6d6-02ca92d93e6f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:00.757117 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ef0f9166-8821-4c0d-a6d6-02ca92d93e6f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:00.757607 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ef0f9166-8821-4c0d-a6d6-02ca92d93e6f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:00.758281 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ef0f9166-8821-4c0d-a6d6-02ca92d93e6f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:00.758715 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ef0f9166-8821-4c0d-a6d6-02ca92d93e6f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:01.443553 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-884fe939-eaab-4d99-9493-ebc0f62de8eb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:01.444581 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-884fe939-eaab-4d99-9493-ebc0f62de8eb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:01.451811 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-884fe939-eaab-4d99-9493-ebc0f62de8eb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:01.452254 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-884fe939-eaab-4d99-9493-ebc0f62de8eb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:01.453119 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-884fe939-eaab-4d99-9493-ebc0f62de8eb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:01.453616 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-884fe939-eaab-4d99-9493-ebc0f62de8eb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:01.498460 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-884fe939-eaab-4d99-9493-ebc0f62de8eb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058856 Aug 24 19:32:01.503674 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 183/379] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:32:01 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 19:32:01.505483 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-90964103-0594-49c9-a07a-2cd0d5e6e3a0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:01.506252 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-90964103-0594-49c9-a07a-2cd0d5e6e3a0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:01.514258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-90964103-0594-49c9-a07a-2cd0d5e6e3a0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:01.514608 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-90964103-0594-49c9-a07a-2cd0d5e6e3a0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:01.515385 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-90964103-0594-49c9-a07a-2cd0d5e6e3a0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:01.515844 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-90964103-0594-49c9-a07a-2cd0d5e6e3a0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:01.719303 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-90964103-0594-49c9-a07a-2cd0d5e6e3a0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:01.730522 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-90964103-0594-49c9-a07a-2cd0d5e6e3a0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.229288 Aug 24 19:32:01.731098 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 184/380] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:01 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:01.735972 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-75141afe-f8c8-4890-9307-9b9216767619 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:01.736899 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-75141afe-f8c8-4890-9307-9b9216767619 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:01.742927 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-75141afe-f8c8-4890-9307-9b9216767619 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:01.744096 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-75141afe-f8c8-4890-9307-9b9216767619 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:01.744231 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-75141afe-f8c8-4890-9307-9b9216767619 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:01.744725 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-75141afe-f8c8-4890-9307-9b9216767619 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:03.503091 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ef0f9166-8821-4c0d-a6d6-02ca92d93e6f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 38048 microversion: 2.20 time: 2.756458 Aug 24 19:32:03.504799 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 197/381] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:32:00 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 38048 bytes in 2759 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:32:03.510682 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1400434312", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "networks": [{"uuid": "6a1a130c-ef7c-4e9a-95ba-539471ebdef0"}]}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:03.526807 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-75141afe-f8c8-4890-9307-9b9216767619 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 38122 microversion: 2.1 time: 1.794276 Aug 24 19:32:03.527615 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 185/382] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:32:01 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 38122 bytes in 1796 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:32:03.532989 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a7af2a41-54ff-41f0-9712-c76832007ca2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:03.533631 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a7af2a41-54ff-41f0-9712-c76832007ca2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:03.540150 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a7af2a41-54ff-41f0-9712-c76832007ca2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:03.540658 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a7af2a41-54ff-41f0-9712-c76832007ca2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:03.541416 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a7af2a41-54ff-41f0-9712-c76832007ca2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:03.541844 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a7af2a41-54ff-41f0-9712-c76832007ca2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:03.564784 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.network.neutron [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] validate_networks() for [('6a1a130c-ef7c-4e9a-95ba-539471ebdef0', None, None, None, None, None)] {{(pid=108908) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:32:03.758517 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a7af2a41-54ff-41f0-9712-c76832007ca2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:03.766951 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a7af2a41-54ff-41f0-9712-c76832007ca2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.237672 Aug 24 19:32:03.767787 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 186/383] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:03 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:03.994562 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Flavor limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:32:03.994988 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Image limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:32:03.995455 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Flavor pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:32:03.995859 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Image pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:32:03.996283 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:32:04.004871 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:04.009718 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:04.009718 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:04.009718 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:04.022269 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Getting quotas for project 7a54174229cb4b11bc07726eece4a2af. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:32:04.026170 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Getting quotas for user 3c437fd9d3774ba58eb9b4726b7667b5 and project 7a54174229cb4b11bc07726eece4a2af. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:32:04.036851 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Going to run 1 instances... {{(pid=108908) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:32:04.039833 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:32:04.199598 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a04d9d3b-5966-4719-8eeb-ec9a6ed29ce3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693320 Aug 24 19:32:04.203270 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 198/384] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:32:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:32:04.210089 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9fd380f5-1657-4048-8f43-0643dd1dadd4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:04.210703 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9fd380f5-1657-4048-8f43-0643dd1dadd4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:04.263098 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9fd380f5-1657-4048-8f43-0643dd1dadd4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:04.270508 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9fd380f5-1657-4048-8f43-0643dd1dadd4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1218 microversion: 2.1 time: 0.064100 Aug 24 19:32:04.271257 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 187/385] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:04 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:04.515347 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-02abe3cb-b7b9-4aad-a685-45536b6c4035 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:04.516423 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-02abe3cb-b7b9-4aad-a685-45536b6c4035 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:04.524349 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-02abe3cb-b7b9-4aad-a685-45536b6c4035 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:04.524789 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-02abe3cb-b7b9-4aad-a685-45536b6c4035 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:04.525548 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-02abe3cb-b7b9-4aad-a685-45536b6c4035 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:04.525971 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-02abe3cb-b7b9-4aad-a685-45536b6c4035 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:04.539311 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7ffd58e7-4384-4f06-8891-5c812a521fd1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:04.543093 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7ffd58e7-4384-4f06-8891-5c812a521fd1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:04.553190 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7ffd58e7-4384-4f06-8891-5c812a521fd1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:04.553634 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7ffd58e7-4384-4f06-8891-5c812a521fd1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:04.554406 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7ffd58e7-4384-4f06-8891-5c812a521fd1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:04.554863 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7ffd58e7-4384-4f06-8891-5c812a521fd1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:04.610046 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-02abe3cb-b7b9-4aad-a685-45536b6c4035 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 38048 microversion: 2.20 time: 0.098732 Aug 24 19:32:04.610690 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 199/386] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:32:04 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 38048 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:32:04.640185 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7ffd58e7-4384-4f06-8891-5c812a521fd1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 38124 microversion: 2.1 time: 0.104831 Aug 24 19:32:04.640978 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 188/387] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:32:04 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 38124 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:32:04.790725 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9591fafa-c4e9-46ca-b934-c0c69f7d0c47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:04.791419 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9591fafa-c4e9-46ca-b934-c0c69f7d0c47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:04.798252 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9591fafa-c4e9-46ca-b934-c0c69f7d0c47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:04.798901 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9591fafa-c4e9-46ca-b934-c0c69f7d0c47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:04.799684 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9591fafa-c4e9-46ca-b934-c0c69f7d0c47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:04.800111 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9591fafa-c4e9-46ca-b934-c0c69f7d0c47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:04.949774 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9591fafa-c4e9-46ca-b934-c0c69f7d0c47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:04.957060 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9591fafa-c4e9-46ca-b934-c0c69f7d0c47 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.170923 Aug 24 19:32:04.957625 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 200/388] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:04 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:05.288782 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-32b20937-c847-418d-9497-99463467a403 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:05.290103 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-32b20937-c847-418d-9497-99463467a403 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:05.297502 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-32b20937-c847-418d-9497-99463467a403 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:05.297941 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-32b20937-c847-418d-9497-99463467a403 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:05.298710 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-32b20937-c847-418d-9497-99463467a403 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:05.299134 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-32b20937-c847-418d-9497-99463467a403 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:05.367069 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-32b20937-c847-418d-9497-99463467a403 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:05.376552 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-32b20937-c847-418d-9497-99463467a403 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1222 microversion: 2.1 time: 0.092055 Aug 24 19:32:05.377144 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 189/389] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:05 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:05.623283 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b44a6c64-57a4-4450-924c-ecc74d875569 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:05.624241 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b44a6c64-57a4-4450-924c-ecc74d875569 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:05.630070 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b44a6c64-57a4-4450-924c-ecc74d875569 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:05.630419 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b44a6c64-57a4-4450-924c-ecc74d875569 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:05.631198 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b44a6c64-57a4-4450-924c-ecc74d875569 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:05.631627 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b44a6c64-57a4-4450-924c-ecc74d875569 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:05.652209 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-591fdbbc-a1e1-41cb-90ef-3c8f94ea415f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:05.653268 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-591fdbbc-a1e1-41cb-90ef-3c8f94ea415f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:05.660158 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-591fdbbc-a1e1-41cb-90ef-3c8f94ea415f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:05.660620 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-591fdbbc-a1e1-41cb-90ef-3c8f94ea415f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:05.661380 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-591fdbbc-a1e1-41cb-90ef-3c8f94ea415f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:05.661806 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-591fdbbc-a1e1-41cb-90ef-3c8f94ea415f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:05.718335 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b44a6c64-57a4-4450-924c-ecc74d875569 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 200 len: 38189 microversion: 2.20 time: 0.098606 Aug 24 19:32:05.719243 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 201/390] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:32:05 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 38189 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:32:05.729469 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5794d876-9feb-407a-8073-369ead6563a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:05.730049 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5794d876-9feb-407a-8073-369ead6563a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:05.736528 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5794d876-9feb-407a-8073-369ead6563a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:05.736978 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5794d876-9feb-407a-8073-369ead6563a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:05.737746 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5794d876-9feb-407a-8073-369ead6563a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:05.738177 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5794d876-9feb-407a-8073-369ead6563a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:05.757488 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-591fdbbc-a1e1-41cb-90ef-3c8f94ea415f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 200 len: 38251 microversion: 2.1 time: 0.109141 Aug 24 19:32:05.759380 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 190/391] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:32:05 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 38251 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:32:05.771172 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-60106d74-0262-49a6-bb4b-60cf94644715 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:05.771677 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5794d876-9feb-407a-8073-369ead6563a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/ips" status: 200 len: 151 microversion: 2.20 time: 0.046096 Aug 24 19:32:05.771788 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-60106d74-0262-49a6-bb4b-60cf94644715 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:05.772990 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 202/392] 10.222.0.59 () {60 vars in 1289 bytes} [Tue Aug 24 19:32:05 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:32:05.778649 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-60106d74-0262-49a6-bb4b-60cf94644715 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:05.779102 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-60106d74-0262-49a6-bb4b-60cf94644715 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:05.779870 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-60106d74-0262-49a6-bb4b-60cf94644715 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:05.780321 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-60106d74-0262-49a6-bb4b-60cf94644715 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:05.805960 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-60106d74-0262-49a6-bb4b-60cf94644715 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/ips" status: 200 len: 145 microversion: 2.1 time: 0.037612 Aug 24 19:32:05.806803 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 191/393] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 24 19:32:05 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:32:05.973193 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-85b866f3-2e55-4090-8841-272b218f6650 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:05.973851 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-85b866f3-2e55-4090-8841-272b218f6650 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:05.980288 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-85b866f3-2e55-4090-8841-272b218f6650 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:05.980767 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-85b866f3-2e55-4090-8841-272b218f6650 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:05.981528 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-85b866f3-2e55-4090-8841-272b218f6650 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:05.981956 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-85b866f3-2e55-4090-8841-272b218f6650 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:06.104936 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-85b866f3-2e55-4090-8841-272b218f6650 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:06.112185 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-85b866f3-2e55-4090-8841-272b218f6650 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.142683 Aug 24 19:32:06.112776 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 203/394] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:05 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:06.393107 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4fd6adc8-4188-4774-b9af-33b19e63a231 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:06.393704 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4fd6adc8-4188-4774-b9af-33b19e63a231 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:06.400082 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4fd6adc8-4188-4774-b9af-33b19e63a231 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:06.400527 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4fd6adc8-4188-4774-b9af-33b19e63a231 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:06.401408 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4fd6adc8-4188-4774-b9af-33b19e63a231 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:06.401829 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4fd6adc8-4188-4774-b9af-33b19e63a231 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:06.464985 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4fd6adc8-4188-4774-b9af-33b19e63a231 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:06.472256 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4fd6adc8-4188-4774-b9af-33b19e63a231 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1270 microversion: 2.1 time: 0.083005 Aug 24 19:32:06.476004 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 192/395] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:06 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:07.129902 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-742e16fe-c120-4e66-831f-1a177d407251 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:07.130512 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-742e16fe-c120-4e66-831f-1a177d407251 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:07.137646 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-742e16fe-c120-4e66-831f-1a177d407251 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:07.140827 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-742e16fe-c120-4e66-831f-1a177d407251 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:07.140827 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-742e16fe-c120-4e66-831f-1a177d407251 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:07.140827 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-742e16fe-c120-4e66-831f-1a177d407251 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:07.263857 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-742e16fe-c120-4e66-831f-1a177d407251 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:07.271544 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-742e16fe-c120-4e66-831f-1a177d407251 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.145555 Aug 24 19:32:07.281706 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 204/396] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:07 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:07.490082 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c7cf1cd5-9182-41b3-b147-547707e27e77 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:07.490672 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c7cf1cd5-9182-41b3-b147-547707e27e77 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:07.497333 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7cf1cd5-9182-41b3-b147-547707e27e77 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:07.497784 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7cf1cd5-9182-41b3-b147-547707e27e77 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:07.499328 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7cf1cd5-9182-41b3-b147-547707e27e77 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:07.499328 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7cf1cd5-9182-41b3-b147-547707e27e77 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:07.563738 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c7cf1cd5-9182-41b3-b147-547707e27e77 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:07.571631 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c7cf1cd5-9182-41b3-b147-547707e27e77 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1270 microversion: 2.1 time: 0.085191 Aug 24 19:32:07.572296 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 193/397] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:07 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:08.289230 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a261fc82-c056-4a22-9028-cf50abdb4f7c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:08.289832 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a261fc82-c056-4a22-9028-cf50abdb4f7c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:08.295886 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a261fc82-c056-4a22-9028-cf50abdb4f7c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:08.296362 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a261fc82-c056-4a22-9028-cf50abdb4f7c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:08.297125 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a261fc82-c056-4a22-9028-cf50abdb4f7c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:08.297554 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a261fc82-c056-4a22-9028-cf50abdb4f7c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:08.423584 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a261fc82-c056-4a22-9028-cf50abdb4f7c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:08.431557 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a261fc82-c056-4a22-9028-cf50abdb4f7c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.145994 Aug 24 19:32:08.432147 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 205/398] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:08 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:08.588707 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8f899c35-a04f-403b-942a-1c7bfb3d5a12 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:08.589269 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8f899c35-a04f-403b-942a-1c7bfb3d5a12 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:08.595119 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f899c35-a04f-403b-942a-1c7bfb3d5a12 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:08.595546 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f899c35-a04f-403b-942a-1c7bfb3d5a12 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:08.596322 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f899c35-a04f-403b-942a-1c7bfb3d5a12 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:08.596748 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f899c35-a04f-403b-942a-1c7bfb3d5a12 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:08.655812 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8f899c35-a04f-403b-942a-1c7bfb3d5a12 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:08.663032 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8f899c35-a04f-403b-942a-1c7bfb3d5a12 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1270 microversion: 2.1 time: 0.078534 Aug 24 19:32:08.664219 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 194/399] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:08 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1270 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:09.449662 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6e22debd-9e8c-465d-a22e-42d628dd86ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:09.450422 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6e22debd-9e8c-465d-a22e-42d628dd86ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:09.457030 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6e22debd-9e8c-465d-a22e-42d628dd86ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:09.457487 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6e22debd-9e8c-465d-a22e-42d628dd86ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:09.458317 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6e22debd-9e8c-465d-a22e-42d628dd86ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:09.458945 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6e22debd-9e8c-465d-a22e-42d628dd86ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:09.587988 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6e22debd-9e8c-465d-a22e-42d628dd86ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:09.595226 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6e22debd-9e8c-465d-a22e-42d628dd86ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.149318 Aug 24 19:32:09.595792 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 206/400] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:09 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:09.681104 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1bd93450-4529-4436-82cd-878309e9555b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:09.681658 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1bd93450-4529-4436-82cd-878309e9555b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:09.687842 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1bd93450-4529-4436-82cd-878309e9555b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:09.688290 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1bd93450-4529-4436-82cd-878309e9555b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:09.689052 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1bd93450-4529-4436-82cd-878309e9555b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:09.689477 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1bd93450-4529-4436-82cd-878309e9555b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:09.749572 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1bd93450-4529-4436-82cd-878309e9555b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:09.756745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1bd93450-4529-4436-82cd-878309e9555b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1278 microversion: 2.1 time: 0.079961 Aug 24 19:32:09.757499 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 195/401] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:09 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1278 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:10.611936 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1aeadd5f-e2d3-4a81-bd7a-865c71de0e0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:10.612638 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1aeadd5f-e2d3-4a81-bd7a-865c71de0e0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:10.618440 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1aeadd5f-e2d3-4a81-bd7a-865c71de0e0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:10.618888 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1aeadd5f-e2d3-4a81-bd7a-865c71de0e0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:10.619661 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1aeadd5f-e2d3-4a81-bd7a-865c71de0e0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:10.620139 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1aeadd5f-e2d3-4a81-bd7a-865c71de0e0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:10.741349 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1aeadd5f-e2d3-4a81-bd7a-865c71de0e0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:10.748835 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1aeadd5f-e2d3-4a81-bd7a-865c71de0e0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.140631 Aug 24 19:32:10.749404 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 207/402] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:10 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:10.774089 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9c96d18a-1517-41ac-8076-61fe936b2502 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:10.774712 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9c96d18a-1517-41ac-8076-61fe936b2502 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:10.780573 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9c96d18a-1517-41ac-8076-61fe936b2502 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:10.781010 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9c96d18a-1517-41ac-8076-61fe936b2502 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:10.781755 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9c96d18a-1517-41ac-8076-61fe936b2502 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:10.782176 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9c96d18a-1517-41ac-8076-61fe936b2502 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:10.842246 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9c96d18a-1517-41ac-8076-61fe936b2502 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:10.849416 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9c96d18a-1517-41ac-8076-61fe936b2502 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1278 microversion: 2.1 time: 0.079571 Aug 24 19:32:10.849970 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 196/403] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:10 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1278 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:11.765836 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-cb321247-fb60-4333-b96b-9264d98452ba tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:11.766430 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-cb321247-fb60-4333-b96b-9264d98452ba tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:11.772354 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cb321247-fb60-4333-b96b-9264d98452ba tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:11.773297 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cb321247-fb60-4333-b96b-9264d98452ba tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:11.774064 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cb321247-fb60-4333-b96b-9264d98452ba tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:11.774492 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cb321247-fb60-4333-b96b-9264d98452ba tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:11.865883 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b8f37380-46cb-4139-9034-29e4e0dcd655 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:11.866617 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b8f37380-46cb-4139-9034-29e4e0dcd655 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:11.872560 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8f37380-46cb-4139-9034-29e4e0dcd655 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:11.873082 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8f37380-46cb-4139-9034-29e4e0dcd655 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:11.873923 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8f37380-46cb-4139-9034-29e4e0dcd655 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:11.874436 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8f37380-46cb-4139-9034-29e4e0dcd655 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:11.891676 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-cb321247-fb60-4333-b96b-9264d98452ba tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:11.899640 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-cb321247-fb60-4333-b96b-9264d98452ba tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.137465 Aug 24 19:32:11.900245 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 208/404] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:11 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:11.933805 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b8f37380-46cb-4139-9034-29e4e0dcd655 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:11.941233 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b8f37380-46cb-4139-9034-29e4e0dcd655 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1278 microversion: 2.1 time: 0.079129 Aug 24 19:32:11.941786 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 197/405] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:11 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1278 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:12.917203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-aa807d9b-04f3-444f-b25a-5e0cf145c337 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:12.917968 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-aa807d9b-04f3-444f-b25a-5e0cf145c337 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:12.924341 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aa807d9b-04f3-444f-b25a-5e0cf145c337 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:12.924780 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aa807d9b-04f3-444f-b25a-5e0cf145c337 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:12.925545 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aa807d9b-04f3-444f-b25a-5e0cf145c337 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:12.925971 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aa807d9b-04f3-444f-b25a-5e0cf145c337 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:12.957900 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9dcdb02d-64c2-4145-b2d4-a23a14e7a368 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:12.958711 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9dcdb02d-64c2-4145-b2d4-a23a14e7a368 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:12.964791 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9dcdb02d-64c2-4145-b2d4-a23a14e7a368 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:12.965285 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9dcdb02d-64c2-4145-b2d4-a23a14e7a368 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:12.966053 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9dcdb02d-64c2-4145-b2d4-a23a14e7a368 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:12.966671 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9dcdb02d-64c2-4145-b2d4-a23a14e7a368 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:13.043718 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9dcdb02d-64c2-4145-b2d4-a23a14e7a368 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:13.050988 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9dcdb02d-64c2-4145-b2d4-a23a14e7a368 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1276 microversion: 2.1 time: 0.096719 Aug 24 19:32:13.051746 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 198/406] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:12 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1276 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:13.093763 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-aa807d9b-04f3-444f-b25a-5e0cf145c337 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:13.101842 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-aa807d9b-04f3-444f-b25a-5e0cf145c337 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.189160 Aug 24 19:32:13.102420 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 209/407] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:12 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:14.068564 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-715416c6-d007-48ef-ad78-e4b841f97ed4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:14.069187 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-715416c6-d007-48ef-ad78-e4b841f97ed4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:14.076085 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-715416c6-d007-48ef-ad78-e4b841f97ed4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:14.076566 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-715416c6-d007-48ef-ad78-e4b841f97ed4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:14.077327 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-715416c6-d007-48ef-ad78-e4b841f97ed4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:14.077771 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-715416c6-d007-48ef-ad78-e4b841f97ed4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:14.118917 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0f2b2ae0-94d1-431d-9dfb-0fde7c065c67 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:14.119517 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0f2b2ae0-94d1-431d-9dfb-0fde7c065c67 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:14.125752 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0f2b2ae0-94d1-431d-9dfb-0fde7c065c67 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:14.126254 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0f2b2ae0-94d1-431d-9dfb-0fde7c065c67 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:14.127016 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0f2b2ae0-94d1-431d-9dfb-0fde7c065c67 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:14.127445 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0f2b2ae0-94d1-431d-9dfb-0fde7c065c67 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:14.222425 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-715416c6-d007-48ef-ad78-e4b841f97ed4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:14.230451 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-715416c6-d007-48ef-ad78-e4b841f97ed4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1318 microversion: 2.1 time: 0.165462 Aug 24 19:32:14.231152 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 199/408] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:14 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:14.271210 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0f2b2ae0-94d1-431d-9dfb-0fde7c065c67 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:14.278550 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0f2b2ae0-94d1-431d-9dfb-0fde7c065c67 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.163799 Aug 24 19:32:14.279108 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 210/409] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:14 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:15.247439 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0a43b785-fa63-40ad-9f1e-f01818dcfa82 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:15.248031 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0a43b785-fa63-40ad-9f1e-f01818dcfa82 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:15.253902 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0a43b785-fa63-40ad-9f1e-f01818dcfa82 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:15.254339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0a43b785-fa63-40ad-9f1e-f01818dcfa82 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:15.255086 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0a43b785-fa63-40ad-9f1e-f01818dcfa82 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:15.255506 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0a43b785-fa63-40ad-9f1e-f01818dcfa82 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:15.295042 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4eaad62f-6fee-4fc5-ab1e-28c06151149c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:15.295703 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4eaad62f-6fee-4fc5-ab1e-28c06151149c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:15.301596 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4eaad62f-6fee-4fc5-ab1e-28c06151149c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:15.302049 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4eaad62f-6fee-4fc5-ab1e-28c06151149c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:15.302854 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4eaad62f-6fee-4fc5-ab1e-28c06151149c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:15.303289 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4eaad62f-6fee-4fc5-ab1e-28c06151149c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:15.404302 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0a43b785-fa63-40ad-9f1e-f01818dcfa82 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:15.406301 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0a43b785-fa63-40ad-9f1e-f01818dcfa82 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1318 microversion: 2.1 time: 0.162428 Aug 24 19:32:15.406875 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 200/410] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:15 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:15.450707 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4eaad62f-6fee-4fc5-ab1e-28c06151149c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:15.457842 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4eaad62f-6fee-4fc5-ab1e-28c06151149c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.166852 Aug 24 19:32:15.458399 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 211/411] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:15 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:16.425357 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b3bfdfab-d8ce-49c0-aa79-1549f0045c97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:16.425357 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b3bfdfab-d8ce-49c0-aa79-1549f0045c97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:16.430110 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3bfdfab-d8ce-49c0-aa79-1549f0045c97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:16.430558 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3bfdfab-d8ce-49c0-aa79-1549f0045c97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:16.431314 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3bfdfab-d8ce-49c0-aa79-1549f0045c97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:16.431739 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3bfdfab-d8ce-49c0-aa79-1549f0045c97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:16.474771 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-59ec1c1d-84b7-42a9-9d26-b6a51edc38e2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:16.475364 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-59ec1c1d-84b7-42a9-9d26-b6a51edc38e2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:16.481978 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-59ec1c1d-84b7-42a9-9d26-b6a51edc38e2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:16.485366 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-59ec1c1d-84b7-42a9-9d26-b6a51edc38e2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:16.485366 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-59ec1c1d-84b7-42a9-9d26-b6a51edc38e2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:16.485366 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-59ec1c1d-84b7-42a9-9d26-b6a51edc38e2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:16.717970 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b3bfdfab-d8ce-49c0-aa79-1549f0045c97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:16.725690 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b3bfdfab-d8ce-49c0-aa79-1549f0045c97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1318 microversion: 2.1 time: 0.306344 Aug 24 19:32:16.726370 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 201/412] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:16 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1318 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:16.739242 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-59ec1c1d-84b7-42a9-9d26-b6a51edc38e2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:16.746763 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-59ec1c1d-84b7-42a9-9d26-b6a51edc38e2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.275846 Aug 24 19:32:16.747341 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 212/413] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:16 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:16.990678 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-18fde046-9b5a-4278-8484-58895380b1e1 req-a7ae62f3-b07d-4794-b17d-ff3f1d3bf4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46d2d343-94b5-4688-84f5-89951c4d4555", "tag": "2e1e62a7-e029-4686-a6f1-fc643ec5a30d"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:16.993011 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:32:16.993011 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:32:16.999935 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-18fde046-9b5a-4278-8484-58895380b1e1 req-a7ae62f3-b07d-4794-b17d-ff3f1d3bf4b9 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:17.000414 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-18fde046-9b5a-4278-8484-58895380b1e1 req-a7ae62f3-b07d-4794-b17d-ff3f1d3bf4b9 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:17.014961 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-18fde046-9b5a-4278-8484-58895380b1e1 req-a7ae62f3-b07d-4794-b17d-ff3f1d3bf4b9 service nova] Creating event network-changed:2e1e62a7-e029-4686-a6f1-fc643ec5a30d for instance 46d2d343-94b5-4688-84f5-89951c4d4555 on hv-cinder-79819 Aug 24 19:32:17.020689 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-18fde046-9b5a-4278-8484-58895380b1e1 req-a7ae62f3-b07d-4794-b17d-ff3f1d3bf4b9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033431 Aug 24 19:32:17.021425 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 202/414] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:32:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:32:17.742701 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-58ef7d9e-ccc5-48e0-8ad4-23ca7c95ebd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:17.743296 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-58ef7d9e-ccc5-48e0-8ad4-23ca7c95ebd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:17.749206 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-58ef7d9e-ccc5-48e0-8ad4-23ca7c95ebd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:17.749650 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-58ef7d9e-ccc5-48e0-8ad4-23ca7c95ebd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:17.750403 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-58ef7d9e-ccc5-48e0-8ad4-23ca7c95ebd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:17.750831 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-58ef7d9e-ccc5-48e0-8ad4-23ca7c95ebd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:17.763042 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5dc7da6c-1cb0-44f2-b777-94185dc55a0b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:17.763758 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5dc7da6c-1cb0-44f2-b777-94185dc55a0b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:17.769652 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5dc7da6c-1cb0-44f2-b777-94185dc55a0b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:17.770092 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5dc7da6c-1cb0-44f2-b777-94185dc55a0b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:17.770847 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5dc7da6c-1cb0-44f2-b777-94185dc55a0b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:17.771273 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5dc7da6c-1cb0-44f2-b777-94185dc55a0b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:17.928944 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-58ef7d9e-ccc5-48e0-8ad4-23ca7c95ebd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:17.933432 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5dc7da6c-1cb0-44f2-b777-94185dc55a0b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:17.936287 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-58ef7d9e-ccc5-48e0-8ad4-23ca7c95ebd3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1318 microversion: 2.1 time: 0.197309 Aug 24 19:32:17.936874 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 213/415] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:17 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:17.940685 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5dc7da6c-1cb0-44f2-b777-94185dc55a0b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.181564 Aug 24 19:32:17.941236 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 203/416] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:17 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:18.952681 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-031bab4f-e9ec-442f-afa9-a540a58c6b89 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:18.953268 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-031bab4f-e9ec-442f-afa9-a540a58c6b89 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:18.957490 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c6d28d81-c0d8-4d25-a392-b75ab7806080 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:18.958086 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c6d28d81-c0d8-4d25-a392-b75ab7806080 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:18.959192 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-031bab4f-e9ec-442f-afa9-a540a58c6b89 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:18.959642 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-031bab4f-e9ec-442f-afa9-a540a58c6b89 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:18.960431 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-031bab4f-e9ec-442f-afa9-a540a58c6b89 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:18.960864 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-031bab4f-e9ec-442f-afa9-a540a58c6b89 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:18.963976 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c6d28d81-c0d8-4d25-a392-b75ab7806080 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:18.964465 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c6d28d81-c0d8-4d25-a392-b75ab7806080 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:18.965455 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c6d28d81-c0d8-4d25-a392-b75ab7806080 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:18.965887 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c6d28d81-c0d8-4d25-a392-b75ab7806080 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:19.133782 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-031bab4f-e9ec-442f-afa9-a540a58c6b89 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:19.139154 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c6d28d81-c0d8-4d25-a392-b75ab7806080 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:19.141475 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-031bab4f-e9ec-442f-afa9-a540a58c6b89 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1318 microversion: 2.1 time: 0.192478 Aug 24 19:32:19.142055 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 214/417] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:18 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:19.146821 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c6d28d81-c0d8-4d25-a392-b75ab7806080 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.192845 Aug 24 19:32:19.147377 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 204/418] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:18 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:20.159100 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-81a245ea-04ec-42f8-8262-0dbba9284f57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:20.159681 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-81a245ea-04ec-42f8-8262-0dbba9284f57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:20.163755 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e559db57-086c-4ff0-8cbb-4498e10a35d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:20.164391 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e559db57-086c-4ff0-8cbb-4498e10a35d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:20.166101 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-81a245ea-04ec-42f8-8262-0dbba9284f57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:20.166544 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-81a245ea-04ec-42f8-8262-0dbba9284f57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:20.167311 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-81a245ea-04ec-42f8-8262-0dbba9284f57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:20.167989 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-81a245ea-04ec-42f8-8262-0dbba9284f57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:20.171676 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e559db57-086c-4ff0-8cbb-4498e10a35d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:20.172088 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e559db57-086c-4ff0-8cbb-4498e10a35d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:20.172896 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e559db57-086c-4ff0-8cbb-4498e10a35d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:20.173359 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e559db57-086c-4ff0-8cbb-4498e10a35d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:20.358203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-81a245ea-04ec-42f8-8262-0dbba9284f57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:20.361075 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e559db57-086c-4ff0-8cbb-4498e10a35d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:20.365721 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-81a245ea-04ec-42f8-8262-0dbba9284f57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1318 microversion: 2.1 time: 0.210437 Aug 24 19:32:20.366297 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 215/419] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:20 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:20.368411 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e559db57-086c-4ff0-8cbb-4498e10a35d3 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.208255 Aug 24 19:32:20.369057 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 205/420] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:20 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:21.076034 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-53b98f1a-9a16-4f30-872b-15aa942646a3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e063645f-0b3b-414e-b3ab-91408afe8432"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:21.083586 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-53b98f1a-9a16-4f30-872b-15aa942646a3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:21.083586 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-53b98f1a-9a16-4f30-872b-15aa942646a3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:21.084220 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-53b98f1a-9a16-4f30-872b-15aa942646a3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:21.085029 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-53b98f1a-9a16-4f30-872b-15aa942646a3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:21.085453 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-53b98f1a-9a16-4f30-872b-15aa942646a3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:21.384001 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0e9a9e95-a191-4e02-8473-186fc95b2d79 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:21.385532 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0e9a9e95-a191-4e02-8473-186fc95b2d79 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:21.392136 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0e9a9e95-a191-4e02-8473-186fc95b2d79 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:21.392855 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0e9a9e95-a191-4e02-8473-186fc95b2d79 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:21.393682 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0e9a9e95-a191-4e02-8473-186fc95b2d79 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:21.394296 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0e9a9e95-a191-4e02-8473-186fc95b2d79 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:21.520826 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0e9a9e95-a191-4e02-8473-186fc95b2d79 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:21.528568 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0e9a9e95-a191-4e02-8473-186fc95b2d79 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1318 microversion: 2.1 time: 0.149424 Aug 24 19:32:21.529131 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 206/421] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:21 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:21.533265 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-eae82956-7485-4a20-aa8a-2a50641e9bee tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:21.533859 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-eae82956-7485-4a20-aa8a-2a50641e9bee tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:21.539314 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eae82956-7485-4a20-aa8a-2a50641e9bee tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:21.539771 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eae82956-7485-4a20-aa8a-2a50641e9bee tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:21.541182 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eae82956-7485-4a20-aa8a-2a50641e9bee tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:21.541612 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eae82956-7485-4a20-aa8a-2a50641e9bee tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:21.665617 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-eae82956-7485-4a20-aa8a-2a50641e9bee tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:21.673212 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-eae82956-7485-4a20-aa8a-2a50641e9bee tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1500 microversion: 2.1 time: 0.143071 Aug 24 19:32:21.673792 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 207/422] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:21 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1500 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:21.690343 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6a1b3c01-ff3e-4b3a-ab17-c6000ccca0bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7ea1798-44d5-46b2-8958-62e450dc020b"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:21.691474 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6a1b3c01-ff3e-4b3a-ab17-c6000ccca0bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:21.698231 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6a1b3c01-ff3e-4b3a-ab17-c6000ccca0bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:21.698669 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6a1b3c01-ff3e-4b3a-ab17-c6000ccca0bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:21.699426 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6a1b3c01-ff3e-4b3a-ab17-c6000ccca0bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:21.699845 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6a1b3c01-ff3e-4b3a-ab17-c6000ccca0bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:21.723498 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-6a1b3c01-ff3e-4b3a-ab17-c6000ccca0bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] HTTP exception thrown: Cannot 'attach_volume' instance 649b4ff1-abbd-4ccb-8b5a-9ba24f560372 while it is in vm_state rescued Aug 24 19:32:21.724089 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6a1b3c01-ff3e-4b3a-ab17-c6000ccca0bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Returning 409 to user: Cannot 'attach_volume' instance 649b4ff1-abbd-4ccb-8b5a-9ba24f560372 while it is in vm_state rescued {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:32:21.724963 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6a1b3c01-ff3e-4b3a-ab17-c6000ccca0bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "POST /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038756 Aug 24 19:32:21.725507 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 208/423] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 24 19:32:21 2021] POST /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 19:32:21.733977 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-31c51410-380a-43cc-937a-e2ca60afb710 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:21.734477 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-31c51410-380a-43cc-937a-e2ca60afb710 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:21.740177 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-31c51410-380a-43cc-937a-e2ca60afb710 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:21.743026 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-31c51410-380a-43cc-937a-e2ca60afb710 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:21.743026 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-31c51410-380a-43cc-937a-e2ca60afb710 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:21.743026 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-31c51410-380a-43cc-937a-e2ca60afb710 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:22.068772 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-31c51410-380a-43cc-937a-e2ca60afb710 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "POST /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/action" status: 202 len: 0 microversion: 2.1 time: 0.338181 Aug 24 19:32:22.078951 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 209/424] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:32:21 2021] POST /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:32:22.098663 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9e9c584a-6b28-439d-90fb-6bccf6d60054 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:22.099507 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9e9c584a-6b28-439d-90fb-6bccf6d60054 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:22.106282 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9e9c584a-6b28-439d-90fb-6bccf6d60054 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:22.106728 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9e9c584a-6b28-439d-90fb-6bccf6d60054 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:22.107577 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9e9c584a-6b28-439d-90fb-6bccf6d60054 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:22.108039 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9e9c584a-6b28-439d-90fb-6bccf6d60054 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:22.244080 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9e9c584a-6b28-439d-90fb-6bccf6d60054 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:22.251794 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9e9c584a-6b28-439d-90fb-6bccf6d60054 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1508 microversion: 2.1 time: 0.158294 Aug 24 19:32:22.252376 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 210/425] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:22 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:22.546046 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a33fe986-275f-467f-b458-5eff4073a16d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:22.546765 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a33fe986-275f-467f-b458-5eff4073a16d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:22.552785 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a33fe986-275f-467f-b458-5eff4073a16d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:22.553224 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a33fe986-275f-467f-b458-5eff4073a16d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:22.553996 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a33fe986-275f-467f-b458-5eff4073a16d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:22.554413 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a33fe986-275f-467f-b458-5eff4073a16d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:22.676156 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a33fe986-275f-467f-b458-5eff4073a16d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:22.687197 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a33fe986-275f-467f-b458-5eff4073a16d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1318 microversion: 2.1 time: 0.144151 Aug 24 19:32:22.696906 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 211/426] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:22 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:23.270117 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a479bfa7-f769-4243-847c-8cf05f5ab802 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:23.270713 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a479bfa7-f769-4243-847c-8cf05f5ab802 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:23.276659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a479bfa7-f769-4243-847c-8cf05f5ab802 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:23.277097 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a479bfa7-f769-4243-847c-8cf05f5ab802 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:23.277847 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a479bfa7-f769-4243-847c-8cf05f5ab802 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:23.278271 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a479bfa7-f769-4243-847c-8cf05f5ab802 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:23.403279 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a479bfa7-f769-4243-847c-8cf05f5ab802 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:23.412570 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a479bfa7-f769-4243-847c-8cf05f5ab802 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1508 microversion: 2.1 time: 0.146057 Aug 24 19:32:23.413517 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 212/427] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:23 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:23.705036 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-81f984fd-7d80-430e-baa2-08ca9fff5007 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:23.705643 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-81f984fd-7d80-430e-baa2-08ca9fff5007 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:23.718339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-81f984fd-7d80-430e-baa2-08ca9fff5007 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:23.718339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-81f984fd-7d80-430e-baa2-08ca9fff5007 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:23.718339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-81f984fd-7d80-430e-baa2-08ca9fff5007 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:23.718339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-81f984fd-7d80-430e-baa2-08ca9fff5007 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:23.875010 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-81f984fd-7d80-430e-baa2-08ca9fff5007 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:23.884067 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-81f984fd-7d80-430e-baa2-08ca9fff5007 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1318 microversion: 2.1 time: 0.182838 Aug 24 19:32:23.884667 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 213/428] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:23 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:24.442173 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d6488ac3-3f37-4040-87bc-88e3ad351823 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:24.446982 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d6488ac3-3f37-4040-87bc-88e3ad351823 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:24.457894 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d6488ac3-3f37-4040-87bc-88e3ad351823 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:24.458343 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d6488ac3-3f37-4040-87bc-88e3ad351823 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:24.462377 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d6488ac3-3f37-4040-87bc-88e3ad351823 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:24.462837 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d6488ac3-3f37-4040-87bc-88e3ad351823 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:24.713752 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-d6488ac3-3f37-4040-87bc-88e3ad351823 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:24.726022 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d6488ac3-3f37-4040-87bc-88e3ad351823 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1508 microversion: 2.1 time: 0.290684 Aug 24 19:32:24.730330 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 214/429] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:24 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1508 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:24.739283 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e0f8e001-7769-46be-be5b-e9ed69ca14f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:24.740141 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e0f8e001-7769-46be-be5b-e9ed69ca14f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:24.763333 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e0f8e001-7769-46be-be5b-e9ed69ca14f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:24.763894 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e0f8e001-7769-46be-be5b-e9ed69ca14f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:24.764743 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e0f8e001-7769-46be-be5b-e9ed69ca14f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:24.769142 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e0f8e001-7769-46be-be5b-e9ed69ca14f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:24.812429 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-e0f8e001-7769-46be-be5b-e9ed69ca14f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lazy-loading 'flavor' on Instance uuid 7c70c776-ec7a-4970-9d9f-baf8c6568257 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:32:24.826150 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-53b98f1a-9a16-4f30-872b-15aa942646a3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.753762 Aug 24 19:32:24.828575 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 216/430] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 24 19:32:21 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/os-volume_attachments => generated 194 bytes in 3756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:32:24.906153 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-37c7fd5e-cdee-4aea-afdb-5fa9a7ddf061 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:24.906852 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-37c7fd5e-cdee-4aea-afdb-5fa9a7ddf061 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:24.919974 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-37c7fd5e-cdee-4aea-afdb-5fa9a7ddf061 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:24.920859 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-37c7fd5e-cdee-4aea-afdb-5fa9a7ddf061 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:24.922051 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-37c7fd5e-cdee-4aea-afdb-5fa9a7ddf061 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:24.922676 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-37c7fd5e-cdee-4aea-afdb-5fa9a7ddf061 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:25.317812 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-37c7fd5e-cdee-4aea-afdb-5fa9a7ddf061 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:25.325347 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-37c7fd5e-cdee-4aea-afdb-5fa9a7ddf061 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1318 microversion: 2.1 time: 0.425925 Aug 24 19:32:25.326143 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 217/431] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:24 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:25.660831 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e0f8e001-7769-46be-be5b-e9ed69ca14f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 202 len: 0 microversion: 2.20 time: 0.932582 Aug 24 19:32:25.661457 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 215/432] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:32:24 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 0 bytes in 934 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:32:25.670206 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1abe4ae9-3ac1-4f13-a868-fe09bb7324a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:25.671084 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1abe4ae9-3ac1-4f13-a868-fe09bb7324a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:25.678813 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1abe4ae9-3ac1-4f13-a868-fe09bb7324a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:25.679659 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1abe4ae9-3ac1-4f13-a868-fe09bb7324a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:25.680719 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1abe4ae9-3ac1-4f13-a868-fe09bb7324a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:25.681330 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1abe4ae9-3ac1-4f13-a868-fe09bb7324a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:25.749058 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-bb5df61b-104d-4c87-be7d-3f42c224bae1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:25.749058 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-bb5df61b-104d-4c87-be7d-3f42c224bae1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:25.755429 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bb5df61b-104d-4c87-be7d-3f42c224bae1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:25.755969 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bb5df61b-104d-4c87-be7d-3f42c224bae1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:25.756978 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bb5df61b-104d-4c87-be7d-3f42c224bae1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:25.757607 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bb5df61b-104d-4c87-be7d-3f42c224bae1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:25.837635 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1abe4ae9-3ac1-4f13-a868-fe09bb7324a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:25.847027 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1abe4ae9-3ac1-4f13-a868-fe09bb7324a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:25.848838 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1abe4ae9-3ac1-4f13-a868-fe09bb7324a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:25.850256 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1abe4ae9-3ac1-4f13-a868-fe09bb7324a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.184805 Aug 24 19:32:25.862541 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 218/433] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:25 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:25.930814 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-bb5df61b-104d-4c87-be7d-3f42c224bae1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:25.939739 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-bb5df61b-104d-4c87-be7d-3f42c224bae1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1508 microversion: 2.1 time: 0.197762 Aug 24 19:32:25.940476 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 216/434] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:25 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:26.342863 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c85c5fb7-7d32-43fe-862a-1fe72db277e6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:26.343497 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-c85c5fb7-7d32-43fe-862a-1fe72db277e6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:26.349511 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c85c5fb7-7d32-43fe-862a-1fe72db277e6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:26.349966 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c85c5fb7-7d32-43fe-862a-1fe72db277e6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:26.350744 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c85c5fb7-7d32-43fe-862a-1fe72db277e6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:26.351171 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c85c5fb7-7d32-43fe-862a-1fe72db277e6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:26.527301 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-c85c5fb7-7d32-43fe-862a-1fe72db277e6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:26.539559 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c85c5fb7-7d32-43fe-862a-1fe72db277e6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1318 microversion: 2.1 time: 0.200177 Aug 24 19:32:26.540915 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 219/435] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:26 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:26.650716 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-0c7f391a-779e-4f8e-8387-ba0891aca685 req-df6489da-a508-46f4-8e12-41e45ef0f94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d2d343-94b5-4688-84f5-89951c4d4555", "name": "network-vif-plugged", "status": "completed", "tag": "2e1e62a7-e029-4686-a6f1-fc643ec5a30d"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:26.652315 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:32:26.652315 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:32:26.659558 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-0c7f391a-779e-4f8e-8387-ba0891aca685 req-df6489da-a508-46f4-8e12-41e45ef0f94b service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:26.664636 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-0c7f391a-779e-4f8e-8387-ba0891aca685 req-df6489da-a508-46f4-8e12-41e45ef0f94b service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:26.671096 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-0c7f391a-779e-4f8e-8387-ba0891aca685 req-df6489da-a508-46f4-8e12-41e45ef0f94b service nova] Creating event network-vif-plugged:2e1e62a7-e029-4686-a6f1-fc643ec5a30d for instance 46d2d343-94b5-4688-84f5-89951c4d4555 on hv-cinder-79819 Aug 24 19:32:26.675879 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-0c7f391a-779e-4f8e-8387-ba0891aca685 req-df6489da-a508-46f4-8e12-41e45ef0f94b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028889 Aug 24 19:32:26.676578 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 217/436] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:32:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:32:26.877590 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-399e137f-56bf-4608-b576-dc5f18f891d3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:26.878211 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-399e137f-56bf-4608-b576-dc5f18f891d3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:26.887513 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-399e137f-56bf-4608-b576-dc5f18f891d3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:26.888222 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-399e137f-56bf-4608-b576-dc5f18f891d3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:26.889532 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-399e137f-56bf-4608-b576-dc5f18f891d3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:26.890186 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-399e137f-56bf-4608-b576-dc5f18f891d3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:26.958098 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-89d15a80-c793-4a22-9552-808fcbdd6b4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:26.958808 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-89d15a80-c793-4a22-9552-808fcbdd6b4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:26.966490 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-89d15a80-c793-4a22-9552-808fcbdd6b4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:26.966925 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-89d15a80-c793-4a22-9552-808fcbdd6b4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:26.967881 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-89d15a80-c793-4a22-9552-808fcbdd6b4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:26.968487 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-89d15a80-c793-4a22-9552-808fcbdd6b4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:27.109931 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-399e137f-56bf-4608-b576-dc5f18f891d3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:27.119374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-399e137f-56bf-4608-b576-dc5f18f891d3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:27.121225 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-399e137f-56bf-4608-b576-dc5f18f891d3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:27.122446 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-399e137f-56bf-4608-b576-dc5f18f891d3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.256722 Aug 24 19:32:27.123202 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 220/437] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:26 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:27.202239 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-89d15a80-c793-4a22-9552-808fcbdd6b4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:27.218613 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-89d15a80-c793-4a22-9552-808fcbdd6b4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1508 microversion: 2.1 time: 0.264521 Aug 24 19:32:27.219375 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 218/438] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:26 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:27.557358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1f2fb715-9585-4edf-8231-5307763bcae8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:27.558235 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1f2fb715-9585-4edf-8231-5307763bcae8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:27.564798 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1f2fb715-9585-4edf-8231-5307763bcae8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:27.565453 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1f2fb715-9585-4edf-8231-5307763bcae8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:27.566242 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1f2fb715-9585-4edf-8231-5307763bcae8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:27.566675 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1f2fb715-9585-4edf-8231-5307763bcae8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:27.691017 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1f2fb715-9585-4edf-8231-5307763bcae8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:27.699005 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1f2fb715-9585-4edf-8231-5307763bcae8 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1318 microversion: 2.1 time: 0.145931 Aug 24 19:32:27.703088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 221/439] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:27 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:28.140804 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6e677fa0-f6bf-48f9-b74c-bb24a39425c1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:28.142297 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6e677fa0-f6bf-48f9-b74c-bb24a39425c1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:28.148644 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6e677fa0-f6bf-48f9-b74c-bb24a39425c1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:28.149263 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6e677fa0-f6bf-48f9-b74c-bb24a39425c1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:28.157909 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6e677fa0-f6bf-48f9-b74c-bb24a39425c1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:28.157909 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6e677fa0-f6bf-48f9-b74c-bb24a39425c1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:28.236079 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1886e03b-0135-476f-ac26-a2ff7f3400b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:28.236755 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1886e03b-0135-476f-ac26-a2ff7f3400b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:28.243589 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1886e03b-0135-476f-ac26-a2ff7f3400b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:28.244118 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1886e03b-0135-476f-ac26-a2ff7f3400b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:28.244922 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1886e03b-0135-476f-ac26-a2ff7f3400b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:28.245355 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1886e03b-0135-476f-ac26-a2ff7f3400b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:28.280883 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6e677fa0-f6bf-48f9-b74c-bb24a39425c1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:28.291120 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6e677fa0-f6bf-48f9-b74c-bb24a39425c1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:28.293210 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6e677fa0-f6bf-48f9-b74c-bb24a39425c1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:28.295933 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6e677fa0-f6bf-48f9-b74c-bb24a39425c1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.156981 Aug 24 19:32:28.295933 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 219/440] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:28 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:28.380567 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1886e03b-0135-476f-ac26-a2ff7f3400b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:28.389090 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1886e03b-0135-476f-ac26-a2ff7f3400b8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1514 microversion: 2.1 time: 0.156552 Aug 24 19:32:28.389659 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 222/441] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:28 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:28.715351 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-52acb439-0a0d-43bb-84d7-a8d316c11a9d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:28.715980 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-52acb439-0a0d-43bb-84d7-a8d316c11a9d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:28.721951 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-52acb439-0a0d-43bb-84d7-a8d316c11a9d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:28.722394 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-52acb439-0a0d-43bb-84d7-a8d316c11a9d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:28.723152 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-52acb439-0a0d-43bb-84d7-a8d316c11a9d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:28.723569 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-52acb439-0a0d-43bb-84d7-a8d316c11a9d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:28.854004 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-52acb439-0a0d-43bb-84d7-a8d316c11a9d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:28.863552 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-52acb439-0a0d-43bb-84d7-a8d316c11a9d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1318 microversion: 2.1 time: 0.151881 Aug 24 19:32:28.864289 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 220/442] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:28 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:29.312530 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a1e1c961-f712-4186-ae1d-f6d3eab11c47 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:29.313143 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a1e1c961-f712-4186-ae1d-f6d3eab11c47 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:29.319052 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a1e1c961-f712-4186-ae1d-f6d3eab11c47 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:29.319499 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a1e1c961-f712-4186-ae1d-f6d3eab11c47 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:29.320987 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a1e1c961-f712-4186-ae1d-f6d3eab11c47 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:29.321420 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a1e1c961-f712-4186-ae1d-f6d3eab11c47 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:29.441852 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a1e1c961-f712-4186-ae1d-f6d3eab11c47 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:29.450228 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a1e1c961-f712-4186-ae1d-f6d3eab11c47 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:29.451720 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a1e1c961-f712-4186-ae1d-f6d3eab11c47 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:29.452882 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a1e1c961-f712-4186-ae1d-f6d3eab11c47 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.144290 Aug 24 19:32:29.453446 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 223/443] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:29 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:29.880137 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-628ef9fd-1fbf-4e20-bc6d-7b996b60535d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:29.880765 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-628ef9fd-1fbf-4e20-bc6d-7b996b60535d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:29.887457 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-628ef9fd-1fbf-4e20-bc6d-7b996b60535d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:29.887907 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-628ef9fd-1fbf-4e20-bc6d-7b996b60535d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:29.888704 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-628ef9fd-1fbf-4e20-bc6d-7b996b60535d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:29.889133 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-628ef9fd-1fbf-4e20-bc6d-7b996b60535d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:30.019714 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-628ef9fd-1fbf-4e20-bc6d-7b996b60535d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:30.027911 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-628ef9fd-1fbf-4e20-bc6d-7b996b60535d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1508 microversion: 2.1 time: 0.151355 Aug 24 19:32:30.028815 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 221/444] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:29 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:30.210647 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-99bf68b7-5d4e-4c2b-ad14-fa05340fe442 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:30.210647 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-99bf68b7-5d4e-4c2b-ad14-fa05340fe442 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:30.218376 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-99bf68b7-5d4e-4c2b-ad14-fa05340fe442 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:30.218904 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-99bf68b7-5d4e-4c2b-ad14-fa05340fe442 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:30.219793 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-99bf68b7-5d4e-4c2b-ad14-fa05340fe442 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:30.221300 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-99bf68b7-5d4e-4c2b-ad14-fa05340fe442 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:30.354630 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-99bf68b7-5d4e-4c2b-ad14-fa05340fe442 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:30.362847 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-99bf68b7-5d4e-4c2b-ad14-fa05340fe442 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1514 microversion: 2.1 time: 0.159977 Aug 24 19:32:30.363737 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 224/445] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:30 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:30.384516 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-50549d61-bedc-415a-ac6b-db8fb4507582 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aed80476-d091-4a6a-a51e-3a5b31aa7db2"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:30.386094 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-50549d61-bedc-415a-ac6b-db8fb4507582 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:30.392858 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-50549d61-bedc-415a-ac6b-db8fb4507582 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:30.395805 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-50549d61-bedc-415a-ac6b-db8fb4507582 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:30.395805 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-50549d61-bedc-415a-ac6b-db8fb4507582 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:30.395805 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-50549d61-bedc-415a-ac6b-db8fb4507582 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:30.471095 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e85da6e0-0229-46fc-bb72-bf7673e2eb1f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:30.471705 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e85da6e0-0229-46fc-bb72-bf7673e2eb1f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:30.478131 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e85da6e0-0229-46fc-bb72-bf7673e2eb1f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:30.478575 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e85da6e0-0229-46fc-bb72-bf7673e2eb1f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:30.479542 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e85da6e0-0229-46fc-bb72-bf7673e2eb1f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:30.480226 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e85da6e0-0229-46fc-bb72-bf7673e2eb1f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:30.601828 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e85da6e0-0229-46fc-bb72-bf7673e2eb1f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:30.609668 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e85da6e0-0229-46fc-bb72-bf7673e2eb1f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:30.611209 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e85da6e0-0229-46fc-bb72-bf7673e2eb1f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:30.612356 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e85da6e0-0229-46fc-bb72-bf7673e2eb1f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.145081 Aug 24 19:32:30.612908 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 225/446] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:30 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:32:31.630830 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-dee292d2-f256-4f2b-b652-3ac6e785d101 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:31.631482 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-dee292d2-f256-4f2b-b652-3ac6e785d101 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:31.639000 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dee292d2-f256-4f2b-b652-3ac6e785d101 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:31.639452 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dee292d2-f256-4f2b-b652-3ac6e785d101 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:31.640235 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dee292d2-f256-4f2b-b652-3ac6e785d101 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:31.640702 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dee292d2-f256-4f2b-b652-3ac6e785d101 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:31.821368 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-dee292d2-f256-4f2b-b652-3ac6e785d101 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:31.830084 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-dee292d2-f256-4f2b-b652-3ac6e785d101 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:31.832736 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-dee292d2-f256-4f2b-b652-3ac6e785d101 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:31.834196 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-dee292d2-f256-4f2b-b652-3ac6e785d101 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.207058 Aug 24 19:32:31.834881 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 226/447] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:31 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:32:32.082439 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b5f03586-2796-4013-831d-7300f0a55281 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fbafe14-94a7-4a3e-a968-947d632dfdd3"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:32.084478 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b5f03586-2796-4013-831d-7300f0a55281 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:32.102038 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b5f03586-2796-4013-831d-7300f0a55281 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:32.102598 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b5f03586-2796-4013-831d-7300f0a55281 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:32.103698 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b5f03586-2796-4013-831d-7300f0a55281 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:32.111003 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b5f03586-2796-4013-831d-7300f0a55281 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:32.142640 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-50549d61-bedc-415a-ac6b-db8fb4507582 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "POST /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.763255 Aug 24 19:32:32.144431 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 222/448] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 24 19:32:30 2021] POST /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/os-volume_attachments => generated 194 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:32:32.854468 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-14a9b6f2-9204-40dc-95a8-fb0911fd1863 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:32.855218 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-14a9b6f2-9204-40dc-95a8-fb0911fd1863 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:32.862337 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-14a9b6f2-9204-40dc-95a8-fb0911fd1863 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:32.862865 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-14a9b6f2-9204-40dc-95a8-fb0911fd1863 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:32.863720 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-14a9b6f2-9204-40dc-95a8-fb0911fd1863 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:32.864213 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-14a9b6f2-9204-40dc-95a8-fb0911fd1863 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:33.115034 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-14a9b6f2-9204-40dc-95a8-fb0911fd1863 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:33.123305 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-14a9b6f2-9204-40dc-95a8-fb0911fd1863 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:33.124845 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-14a9b6f2-9204-40dc-95a8-fb0911fd1863 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:33.126014 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-14a9b6f2-9204-40dc-95a8-fb0911fd1863 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.276208 Aug 24 19:32:33.133089 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 223/449] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:32 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:32:33.744103 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b5f03586-2796-4013-831d-7300f0a55281 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "POST /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.668190 Aug 24 19:32:33.750180 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 227/450] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 24 19:32:32 2021] POST /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555/os-volume_attachments => generated 194 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:32:34.146407 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-282d8a5b-a3a9-4b9d-b636-101b72c1d453 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:34.148347 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-282d8a5b-a3a9-4b9d-b636-101b72c1d453 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:34.158894 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-282d8a5b-a3a9-4b9d-b636-101b72c1d453 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:34.160700 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-282d8a5b-a3a9-4b9d-b636-101b72c1d453 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:34.162018 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-282d8a5b-a3a9-4b9d-b636-101b72c1d453 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:34.162606 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-282d8a5b-a3a9-4b9d-b636-101b72c1d453 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:34.377633 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-282d8a5b-a3a9-4b9d-b636-101b72c1d453 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:34.393408 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-282d8a5b-a3a9-4b9d-b636-101b72c1d453 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:34.396422 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-282d8a5b-a3a9-4b9d-b636-101b72c1d453 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:34.398728 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-282d8a5b-a3a9-4b9d-b636-101b72c1d453 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.255494 Aug 24 19:32:34.399845 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 224/451] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:34 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:34.793954 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ff36172b-44d5-4efe-837d-458525e86b1e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:34.800753 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ff36172b-44d5-4efe-837d-458525e86b1e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:34.800995 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ff36172b-44d5-4efe-837d-458525e86b1e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:35.013137 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ff36172b-44d5-4efe-837d-458525e86b1e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Going to try to stop instance {{(pid=108908) force_stop /opt/stack/nova/nova/compute/api.py:2614}} Aug 24 19:32:35.376034 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ff36172b-44d5-4efe-837d-458525e86b1e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 202 len: 0 microversion: 2.1 time: 0.591365 Aug 24 19:32:35.388596 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-3b21b281-990a-4ed3-9397-d6a1705d3723 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:35.389234 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3b21b281-990a-4ed3-9397-d6a1705d3723 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:35.392419 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 228/452] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:32:34 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:32:35.398027 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3b21b281-990a-4ed3-9397-d6a1705d3723 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:35.398524 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3b21b281-990a-4ed3-9397-d6a1705d3723 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:35.399349 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3b21b281-990a-4ed3-9397-d6a1705d3723 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:35.400198 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3b21b281-990a-4ed3-9397-d6a1705d3723 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:35.420881 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1c2338c2-342e-45a1-af6a-75cc3de6a461 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:35.422833 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1c2338c2-342e-45a1-af6a-75cc3de6a461 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:35.431041 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c2338c2-342e-45a1-af6a-75cc3de6a461 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:35.433082 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c2338c2-342e-45a1-af6a-75cc3de6a461 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:35.434926 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c2338c2-342e-45a1-af6a-75cc3de6a461 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:35.435525 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c2338c2-342e-45a1-af6a-75cc3de6a461 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:35.686943 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3b21b281-990a-4ed3-9397-d6a1705d3723 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:35.697261 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-3b21b281-990a-4ed3-9397-d6a1705d3723 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1722 microversion: 2.1 time: 0.313336 Aug 24 19:32:35.700683 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 225/453] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:35 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:35.760792 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1c2338c2-342e-45a1-af6a-75cc3de6a461 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:35.771531 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1c2338c2-342e-45a1-af6a-75cc3de6a461 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:35.774969 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1c2338c2-342e-45a1-af6a-75cc3de6a461 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:35.776144 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1c2338c2-342e-45a1-af6a-75cc3de6a461 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.361293 Aug 24 19:32:35.776728 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 229/454] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:35 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:32:36.717321 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-27ce51b7-637f-485f-92f8-92acc475ffc3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:36.718420 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-27ce51b7-637f-485f-92f8-92acc475ffc3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:36.724653 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-27ce51b7-637f-485f-92f8-92acc475ffc3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:36.731470 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-27ce51b7-637f-485f-92f8-92acc475ffc3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:36.731470 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-27ce51b7-637f-485f-92f8-92acc475ffc3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:36.731470 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-27ce51b7-637f-485f-92f8-92acc475ffc3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:36.798886 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-42d0be3f-73ca-4bec-8f24-7452877e282e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:36.802632 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-42d0be3f-73ca-4bec-8f24-7452877e282e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:36.809583 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42d0be3f-73ca-4bec-8f24-7452877e282e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:36.810201 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42d0be3f-73ca-4bec-8f24-7452877e282e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:36.810972 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42d0be3f-73ca-4bec-8f24-7452877e282e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:36.811415 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42d0be3f-73ca-4bec-8f24-7452877e282e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:37.012982 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-27ce51b7-637f-485f-92f8-92acc475ffc3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:37.021610 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-27ce51b7-637f-485f-92f8-92acc475ffc3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1722 microversion: 2.1 time: 0.307987 Aug 24 19:32:37.022714 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 226/455] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:36 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:37.098392 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-42d0be3f-73ca-4bec-8f24-7452877e282e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:37.122360 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-42d0be3f-73ca-4bec-8f24-7452877e282e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:37.127120 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-42d0be3f-73ca-4bec-8f24-7452877e282e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:37.129218 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-42d0be3f-73ca-4bec-8f24-7452877e282e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.334044 Aug 24 19:32:37.142217 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 230/456] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:36 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:38.045643 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-64846963-291d-4560-b302-35bdea4f7e8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:38.049452 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-64846963-291d-4560-b302-35bdea4f7e8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:38.063242 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-64846963-291d-4560-b302-35bdea4f7e8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:38.063505 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-64846963-291d-4560-b302-35bdea4f7e8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:38.064807 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-64846963-291d-4560-b302-35bdea4f7e8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:38.065123 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-64846963-291d-4560-b302-35bdea4f7e8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:38.148930 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9a5ddc79-de7b-413c-8fa9-9716c31ce36e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:38.157012 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9a5ddc79-de7b-413c-8fa9-9716c31ce36e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:38.163706 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9a5ddc79-de7b-413c-8fa9-9716c31ce36e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:38.164156 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9a5ddc79-de7b-413c-8fa9-9716c31ce36e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:38.164989 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9a5ddc79-de7b-413c-8fa9-9716c31ce36e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:38.165595 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9a5ddc79-de7b-413c-8fa9-9716c31ce36e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:38.305890 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-64846963-291d-4560-b302-35bdea4f7e8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:38.320418 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-64846963-291d-4560-b302-35bdea4f7e8f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1722 microversion: 2.1 time: 0.283433 Aug 24 19:32:38.322048 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 227/457] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:38 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:38.453297 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9a5ddc79-de7b-413c-8fa9-9716c31ce36e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:38.461317 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9a5ddc79-de7b-413c-8fa9-9716c31ce36e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:38.462806 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9a5ddc79-de7b-413c-8fa9-9716c31ce36e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:38.463946 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9a5ddc79-de7b-413c-8fa9-9716c31ce36e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.320787 Aug 24 19:32:38.464576 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 231/458] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:38 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:39.340437 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-676b5ccc-defa-49c5-9f32-da7e4cd3dd7a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:39.341085 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-676b5ccc-defa-49c5-9f32-da7e4cd3dd7a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:39.348783 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-676b5ccc-defa-49c5-9f32-da7e4cd3dd7a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:39.349494 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-676b5ccc-defa-49c5-9f32-da7e4cd3dd7a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:39.350576 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-676b5ccc-defa-49c5-9f32-da7e4cd3dd7a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:39.351185 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-676b5ccc-defa-49c5-9f32-da7e4cd3dd7a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:39.482043 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-106c20e1-6dbb-4ceb-8cc2-3a666ba5a9b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:39.483287 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-106c20e1-6dbb-4ceb-8cc2-3a666ba5a9b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:39.498107 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-106c20e1-6dbb-4ceb-8cc2-3a666ba5a9b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:39.498537 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-106c20e1-6dbb-4ceb-8cc2-3a666ba5a9b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:39.499325 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-106c20e1-6dbb-4ceb-8cc2-3a666ba5a9b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:39.501322 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-106c20e1-6dbb-4ceb-8cc2-3a666ba5a9b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:39.703927 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-676b5ccc-defa-49c5-9f32-da7e4cd3dd7a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:39.716241 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-676b5ccc-defa-49c5-9f32-da7e4cd3dd7a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1722 microversion: 2.1 time: 0.381508 Aug 24 19:32:39.717262 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 228/459] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:39 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1722 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:39.868701 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-106c20e1-6dbb-4ceb-8cc2-3a666ba5a9b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:39.877082 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-106c20e1-6dbb-4ceb-8cc2-3a666ba5a9b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:39.878560 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-106c20e1-6dbb-4ceb-8cc2-3a666ba5a9b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:39.879749 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-106c20e1-6dbb-4ceb-8cc2-3a666ba5a9b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.401361 Aug 24 19:32:39.891497 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 232/460] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:39 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:32:40.735057 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7fc095b7-113d-46b0-8a9b-4b52c790a799 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:40.744429 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7fc095b7-113d-46b0-8a9b-4b52c790a799 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:40.772736 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7fc095b7-113d-46b0-8a9b-4b52c790a799 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:40.774135 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7fc095b7-113d-46b0-8a9b-4b52c790a799 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:40.777337 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7fc095b7-113d-46b0-8a9b-4b52c790a799 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:40.777785 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7fc095b7-113d-46b0-8a9b-4b52c790a799 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:40.901161 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-de103472-a1dd-4deb-9f80-e3445d6d6701 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:40.907572 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-de103472-a1dd-4deb-9f80-e3445d6d6701 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:40.921835 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-de103472-a1dd-4deb-9f80-e3445d6d6701 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:40.922721 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-de103472-a1dd-4deb-9f80-e3445d6d6701 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:40.924023 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-de103472-a1dd-4deb-9f80-e3445d6d6701 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:40.924895 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-de103472-a1dd-4deb-9f80-e3445d6d6701 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:41.156133 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7fc095b7-113d-46b0-8a9b-4b52c790a799 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:41.177484 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7fc095b7-113d-46b0-8a9b-4b52c790a799 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1722 microversion: 2.1 time: 0.441146 Aug 24 19:32:41.178780 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 229/461] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:40 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1722 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:41.298418 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-de103472-a1dd-4deb-9f80-e3445d6d6701 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:41.319489 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-de103472-a1dd-4deb-9f80-e3445d6d6701 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:41.319489 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-de103472-a1dd-4deb-9f80-e3445d6d6701 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:41.319489 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-de103472-a1dd-4deb-9f80-e3445d6d6701 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.422224 Aug 24 19:32:41.321960 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 233/462] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:40 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:42.197725 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e6808c2b-6871-43bf-9abb-1a0a9f8450a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:42.198919 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e6808c2b-6871-43bf-9abb-1a0a9f8450a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:42.209555 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6808c2b-6871-43bf-9abb-1a0a9f8450a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:42.209999 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6808c2b-6871-43bf-9abb-1a0a9f8450a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:42.210785 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6808c2b-6871-43bf-9abb-1a0a9f8450a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:42.214626 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6808c2b-6871-43bf-9abb-1a0a9f8450a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:42.337039 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-fc39ce10-46a6-4c67-80a1-16c72c51270f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:42.337661 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-fc39ce10-46a6-4c67-80a1-16c72c51270f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:42.351096 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fc39ce10-46a6-4c67-80a1-16c72c51270f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:42.351774 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fc39ce10-46a6-4c67-80a1-16c72c51270f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:42.352914 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fc39ce10-46a6-4c67-80a1-16c72c51270f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:42.355176 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fc39ce10-46a6-4c67-80a1-16c72c51270f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:43.094206 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e6808c2b-6871-43bf-9abb-1a0a9f8450a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:43.099352 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-fc39ce10-46a6-4c67-80a1-16c72c51270f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:43.108988 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e6808c2b-6871-43bf-9abb-1a0a9f8450a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1722 microversion: 2.1 time: 0.917665 Aug 24 19:32:43.119824 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 230/463] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:42 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1722 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:43.120060 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-fc39ce10-46a6-4c67-80a1-16c72c51270f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:43.120060 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-fc39ce10-46a6-4c67-80a1-16c72c51270f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:43.120060 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-fc39ce10-46a6-4c67-80a1-16c72c51270f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.782315 Aug 24 19:32:43.120408 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-cbdbc056-0f55-4c69-a441-6598715d2ba5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:43.120408 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-cbdbc056-0f55-4c69-a441-6598715d2ba5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:43.128520 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cbdbc056-0f55-4c69-a441-6598715d2ba5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:43.129094 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cbdbc056-0f55-4c69-a441-6598715d2ba5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:43.130173 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cbdbc056-0f55-4c69-a441-6598715d2ba5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:43.131792 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cbdbc056-0f55-4c69-a441-6598715d2ba5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:43.134906 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 234/464] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:42 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:32:43.217344 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-cbdbc056-0f55-4c69-a441-6598715d2ba5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lazy-loading 'flavor' on Instance uuid 649b4ff1-abbd-4ccb-8b5a-9ba24f560372 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:32:43.773351 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-cbdbc056-0f55-4c69-a441-6598715d2ba5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "POST /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/action" status: 200 len: 32 microversion: 2.1 time: 0.658734 Aug 24 19:32:43.773986 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 231/465] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:32:43 2021] POST /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/action => generated 32 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:32:43.790213 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-212cb835-c42d-45da-8db7-9ccfd859b2d7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:43.795956 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-212cb835-c42d-45da-8db7-9ccfd859b2d7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:43.817920 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-212cb835-c42d-45da-8db7-9ccfd859b2d7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:43.821447 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-212cb835-c42d-45da-8db7-9ccfd859b2d7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:43.823992 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-212cb835-c42d-45da-8db7-9ccfd859b2d7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:43.825600 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-212cb835-c42d-45da-8db7-9ccfd859b2d7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:44.133037 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-57402289-ce24-4550-8b7b-bcdf3e07f4d7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:44.134546 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-57402289-ce24-4550-8b7b-bcdf3e07f4d7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:44.146840 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-57402289-ce24-4550-8b7b-bcdf3e07f4d7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:44.147280 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-57402289-ce24-4550-8b7b-bcdf3e07f4d7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:44.148063 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-57402289-ce24-4550-8b7b-bcdf3e07f4d7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:44.148521 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-57402289-ce24-4550-8b7b-bcdf3e07f4d7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:44.215509 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-212cb835-c42d-45da-8db7-9ccfd859b2d7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:44.225417 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-212cb835-c42d-45da-8db7-9ccfd859b2d7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.445455 Aug 24 19:32:44.229366 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 235/466] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:43 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:44.248092 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1622e914-18c2-4ee2-acfe-f6487883af66 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:44.250824 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1622e914-18c2-4ee2-acfe-f6487883af66 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:44.267743 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1622e914-18c2-4ee2-acfe-f6487883af66 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:44.269718 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1622e914-18c2-4ee2-acfe-f6487883af66 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:44.270691 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1622e914-18c2-4ee2-acfe-f6487883af66 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:44.273552 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1622e914-18c2-4ee2-acfe-f6487883af66 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:44.784903 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-57402289-ce24-4550-8b7b-bcdf3e07f4d7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:44.813523 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-57402289-ce24-4550-8b7b-bcdf3e07f4d7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1722 microversion: 2.1 time: 0.690042 Aug 24 19:32:44.814610 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 232/467] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:44 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1722 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:44.844142 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1622e914-18c2-4ee2-acfe-f6487883af66 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:44.854001 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1622e914-18c2-4ee2-acfe-f6487883af66 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:44.865711 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1622e914-18c2-4ee2-acfe-f6487883af66 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:44.870379 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1622e914-18c2-4ee2-acfe-f6487883af66 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.628357 Aug 24 19:32:44.871013 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 236/468] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:44 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:45.250408 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0ef340df-6d30-423c-9e34-a05ef25ef8f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:45.251071 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0ef340df-6d30-423c-9e34-a05ef25ef8f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:45.257902 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0ef340df-6d30-423c-9e34-a05ef25ef8f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:45.258569 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0ef340df-6d30-423c-9e34-a05ef25ef8f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:45.259587 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0ef340df-6d30-423c-9e34-a05ef25ef8f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:45.260171 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0ef340df-6d30-423c-9e34-a05ef25ef8f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:45.694665 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0ef340df-6d30-423c-9e34-a05ef25ef8f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:45.704931 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0ef340df-6d30-423c-9e34-a05ef25ef8f5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.460222 Aug 24 19:32:45.728467 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 233/469] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:45 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:45.840007 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b2f9a9cb-9f15-449a-ab61-ceb4278ad0d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:45.840704 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b2f9a9cb-9f15-449a-ab61-ceb4278ad0d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:45.858235 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b2f9a9cb-9f15-449a-ab61-ceb4278ad0d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:45.858813 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b2f9a9cb-9f15-449a-ab61-ceb4278ad0d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:45.859649 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b2f9a9cb-9f15-449a-ab61-ceb4278ad0d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:45.860200 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b2f9a9cb-9f15-449a-ab61-ceb4278ad0d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:45.896695 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-84da4ccc-bdc3-4441-900a-7d865308ecd0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:45.897454 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-84da4ccc-bdc3-4441-900a-7d865308ecd0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:45.909984 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-84da4ccc-bdc3-4441-900a-7d865308ecd0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:45.910427 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-84da4ccc-bdc3-4441-900a-7d865308ecd0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:45.911566 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-84da4ccc-bdc3-4441-900a-7d865308ecd0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:45.912611 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-84da4ccc-bdc3-4441-900a-7d865308ecd0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:46.795597 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-84da4ccc-bdc3-4441-900a-7d865308ecd0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:46.803983 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-84da4ccc-bdc3-4441-900a-7d865308ecd0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:46.805504 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-84da4ccc-bdc3-4441-900a-7d865308ecd0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:46.806864 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-84da4ccc-bdc3-4441-900a-7d865308ecd0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.922241 Aug 24 19:32:46.807575 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 234/470] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:45 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:46.813045 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b2f9a9cb-9f15-449a-ab61-ceb4278ad0d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:46.813235 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1471969360", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "networks": [{"uuid": "7ced5917-82bb-4891-9019-04676b591e11"}]}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:46.823925 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b2f9a9cb-9f15-449a-ab61-ceb4278ad0d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1722 microversion: 2.1 time: 0.994640 Aug 24 19:32:46.834687 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 237/471] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:45 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1722 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:46.834687 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e3d07041-a726-4224-aec4-568eff5dcd82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:46.834687 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e3d07041-a726-4224-aec4-568eff5dcd82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:46.842362 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3d07041-a726-4224-aec4-568eff5dcd82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:46.842362 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3d07041-a726-4224-aec4-568eff5dcd82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:46.842362 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3d07041-a726-4224-aec4-568eff5dcd82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:46.843636 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3d07041-a726-4224-aec4-568eff5dcd82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:46.884382 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.network.neutron [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] validate_networks() for [('7ced5917-82bb-4891-9019-04676b591e11', None, None, None, None, None)] {{(pid=108907) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:32:47.283425 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e3d07041-a726-4224-aec4-568eff5dcd82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:47.296826 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e3d07041-a726-4224-aec4-568eff5dcd82 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.470243 Aug 24 19:32:47.297987 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 238/472] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:46 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:47.798916 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Flavor limits 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:32:47.800444 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Image limits 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:32:47.801378 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Flavor pref 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:32:47.802026 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Image pref 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:32:47.802674 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:32:47.816242 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:47.822981 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:47.822981 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:47.822981 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:47.826806 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f61e523b-976a-442d-85a5-6e4e2d3402b9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:47.827499 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f61e523b-976a-442d-85a5-6e4e2d3402b9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:47.838506 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f61e523b-976a-442d-85a5-6e4e2d3402b9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:47.838986 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f61e523b-976a-442d-85a5-6e4e2d3402b9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:47.839848 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f61e523b-976a-442d-85a5-6e4e2d3402b9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:47.847749 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f61e523b-976a-442d-85a5-6e4e2d3402b9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:47.870561 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Getting quotas for project 5ed4565c07554a2e8dd34da9c4f80956. Resources: {'cores', 'ram', 'instances'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:32:47.885208 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Getting quotas for user 77c66020d31a4598995dcabb76ce4362 and project 5ed4565c07554a2e8dd34da9c4f80956. Resources: {'cores', 'ram', 'instances'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:32:47.906857 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Going to run 1 instances... {{(pid=108907) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:32:47.909844 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:32:48.049699 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f61e523b-976a-442d-85a5-6e4e2d3402b9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:48.060063 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f61e523b-976a-442d-85a5-6e4e2d3402b9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:48.064805 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f61e523b-976a-442d-85a5-6e4e2d3402b9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:48.066385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f61e523b-976a-442d-85a5-6e4e2d3402b9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.245060 Aug 24 19:32:48.069203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 239/473] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:47 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:32:48.087364 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-3bba42f6-16ff-4fac-aee1-92a1eaf714f3 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.278516 Aug 24 19:32:48.093540 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 235/474] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:32:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 1285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:32:48.098417 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-da2af429-391e-4398-952a-558ff14d46d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:48.099081 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-da2af429-391e-4398-952a-558ff14d46d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:48.105590 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-da2af429-391e-4398-952a-558ff14d46d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:48.106046 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-da2af429-391e-4398-952a-558ff14d46d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:48.106842 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-da2af429-391e-4398-952a-558ff14d46d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:48.107279 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-da2af429-391e-4398-952a-558ff14d46d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:48.355131 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-da2af429-391e-4398-952a-558ff14d46d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:48.370309 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-da2af429-391e-4398-952a-558ff14d46d1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1722 microversion: 2.1 time: 0.275616 Aug 24 19:32:48.372298 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 236/475] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:48 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:48.388340 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e07807fc-c097-4cf2-905a-eb496764c104 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:48.389634 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e07807fc-c097-4cf2-905a-eb496764c104 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:48.480370 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e07807fc-c097-4cf2-905a-eb496764c104 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:48.487594 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e07807fc-c097-4cf2-905a-eb496764c104 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1214 microversion: 2.1 time: 0.110919 Aug 24 19:32:48.490821 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 237/476] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:48 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:48.497406 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-2a28eb41-854b-4f04-8154-b099de72d870 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:48.498233 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-2a28eb41-854b-4f04-8154-b099de72d870 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:48.510899 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2a28eb41-854b-4f04-8154-b099de72d870 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:48.511858 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2a28eb41-854b-4f04-8154-b099de72d870 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:48.513190 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2a28eb41-854b-4f04-8154-b099de72d870 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:48.513841 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2a28eb41-854b-4f04-8154-b099de72d870 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:48.606319 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-db36eeb2-8e0f-4bca-89a4-780b76a8b68b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Action: 'create', calling method: .version_select at 0x7f8df7cc4940>, body: {"keypair": {"name": "tempest-TestShelveInstance-948258038"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:48.691220 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-db36eeb2-8e0f-4bca-89a4-780b76a8b68b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Getting quotas for project c635296755b449db8c99cc0b86f4702f. Resources: {'key_pairs'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:32:48.702802 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-db36eeb2-8e0f-4bca-89a4-780b76a8b68b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Getting quotas for user 370ccbd2eb144262b58fd4dd35f391f6 and project c635296755b449db8c99cc0b86f4702f. Resources: {'key_pairs'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:32:48.828534 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2a28eb41-854b-4f04-8154-b099de72d870 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:48.842899 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-2a28eb41-854b-4f04-8154-b099de72d870 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.346551 Aug 24 19:32:48.845722 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 238/477] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:48 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:49.089793 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-004fe44a-8570-4bfa-a509-8cd25fced063 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:49.090395 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-004fe44a-8570-4bfa-a509-8cd25fced063 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:49.113402 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-004fe44a-8570-4bfa-a509-8cd25fced063 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:49.113766 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-004fe44a-8570-4bfa-a509-8cd25fced063 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:49.114586 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-004fe44a-8570-4bfa-a509-8cd25fced063 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:49.115023 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-004fe44a-8570-4bfa-a509-8cd25fced063 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:49.329823 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-db36eeb2-8e0f-4bca-89a4-780b76a8b68b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Getting quotas for project c635296755b449db8c99cc0b86f4702f. Resources: {'key_pairs'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:32:49.334921 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-db36eeb2-8e0f-4bca-89a4-780b76a8b68b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Getting quotas for user 370ccbd2eb144262b58fd4dd35f391f6 and project c635296755b449db8c99cc0b86f4702f. Resources: {'key_pairs'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:32:49.373255 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-db36eeb2-8e0f-4bca-89a4-780b76a8b68b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 1.301039 Aug 24 19:32:49.374102 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 240/478] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Aug 24 19:32:48 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:49.375303 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-004fe44a-8570-4bfa-a509-8cd25fced063 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:49.386238 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-004fe44a-8570-4bfa-a509-8cd25fced063 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:49.393889 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-004fe44a-8570-4bfa-a509-8cd25fced063 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:49.393889 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-004fe44a-8570-4bfa-a509-8cd25fced063 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.303729 Aug 24 19:32:49.393889 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 239/479] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:49 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:49.396947 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-aa60d1fe-54c4-4a8e-9203-e13240134a90 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:49.398017 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-aa60d1fe-54c4-4a8e-9203-e13240134a90 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:49.405020 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aa60d1fe-54c4-4a8e-9203-e13240134a90 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:49.405811 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aa60d1fe-54c4-4a8e-9203-e13240134a90 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:49.411024 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aa60d1fe-54c4-4a8e-9203-e13240134a90 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:49.412099 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aa60d1fe-54c4-4a8e-9203-e13240134a90 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:49.509593 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d42a5ffd-e5ad-4a5b-b22a-63049e0cf396 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:49.510472 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d42a5ffd-e5ad-4a5b-b22a-63049e0cf396 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:49.603490 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-d42a5ffd-e5ad-4a5b-b22a-63049e0cf396 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:49.608773 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d42a5ffd-e5ad-4a5b-b22a-63049e0cf396 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1214 microversion: 2.1 time: 0.104824 Aug 24 19:32:49.625151 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 240/480] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:49 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:49.732347 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-aa60d1fe-54c4-4a8e-9203-e13240134a90 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:49.744148 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-aa60d1fe-54c4-4a8e-9203-e13240134a90 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1722 microversion: 2.1 time: 0.357112 Aug 24 19:32:49.747045 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 241/481] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:49 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:49.863525 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d7200baf-edbb-4287-90b5-a07b48a2ed16 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:49.866196 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d7200baf-edbb-4287-90b5-a07b48a2ed16 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:49.876295 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d7200baf-edbb-4287-90b5-a07b48a2ed16 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:49.876842 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d7200baf-edbb-4287-90b5-a07b48a2ed16 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:49.877667 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d7200baf-edbb-4287-90b5-a07b48a2ed16 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:49.878112 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d7200baf-edbb-4287-90b5-a07b48a2ed16 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:50.096713 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-d7200baf-edbb-4287-90b5-a07b48a2ed16 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:50.106265 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d7200baf-edbb-4287-90b5-a07b48a2ed16 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.247398 Aug 24 19:32:50.107489 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 241/482] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:49 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:50.415416 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0e95a881-6392-4b88-977c-9073e50d7506 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:50.415416 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0e95a881-6392-4b88-977c-9073e50d7506 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:50.423139 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0e95a881-6392-4b88-977c-9073e50d7506 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:50.423721 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0e95a881-6392-4b88-977c-9073e50d7506 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:50.424944 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0e95a881-6392-4b88-977c-9073e50d7506 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:50.425663 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0e95a881-6392-4b88-977c-9073e50d7506 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:50.612448 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0e95a881-6392-4b88-977c-9073e50d7506 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:50.629130 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-93b8c235-4a05-442b-ab2a-4f6e2a30941a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:50.635969 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0e95a881-6392-4b88-977c-9073e50d7506 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:50.638648 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0e95a881-6392-4b88-977c-9073e50d7506 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:50.640125 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0e95a881-6392-4b88-977c-9073e50d7506 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.233009 Aug 24 19:32:50.641292 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 242/483] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:50 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:50.647297 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-93b8c235-4a05-442b-ab2a-4f6e2a30941a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:50.660609 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-93b8c235-4a05-442b-ab2a-4f6e2a30941a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:50.661592 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-93b8c235-4a05-442b-ab2a-4f6e2a30941a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:50.662421 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-93b8c235-4a05-442b-ab2a-4f6e2a30941a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:50.668761 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-93b8c235-4a05-442b-ab2a-4f6e2a30941a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:50.762724 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-bc0745b8-106c-4206-85dd-5290c881b53e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:50.763199 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-93b8c235-4a05-442b-ab2a-4f6e2a30941a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:50.764165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-bc0745b8-106c-4206-85dd-5290c881b53e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:50.771574 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bc0745b8-106c-4206-85dd-5290c881b53e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:50.772456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bc0745b8-106c-4206-85dd-5290c881b53e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:50.773654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bc0745b8-106c-4206-85dd-5290c881b53e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:50.774243 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bc0745b8-106c-4206-85dd-5290c881b53e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:50.774762 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-93b8c235-4a05-442b-ab2a-4f6e2a30941a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1266 microversion: 2.1 time: 0.150489 Aug 24 19:32:50.775350 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 242/484] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:50 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:50.905641 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-bff53d66-25c9-4048-8bae-f1013c352eb3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:50.907209 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-bff53d66-25c9-4048-8bae-f1013c352eb3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:50.920396 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bff53d66-25c9-4048-8bae-f1013c352eb3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:50.921246 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bff53d66-25c9-4048-8bae-f1013c352eb3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:50.922225 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bff53d66-25c9-4048-8bae-f1013c352eb3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:50.924819 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bff53d66-25c9-4048-8bae-f1013c352eb3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:51.004959 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-bc0745b8-106c-4206-85dd-5290c881b53e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:51.013842 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-bc0745b8-106c-4206-85dd-5290c881b53e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1722 microversion: 2.1 time: 0.255667 Aug 24 19:32:51.016334 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 243/485] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:50 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:51.132803 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-77716526-cabb-4824-8032-031557d158ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:51.132803 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-77716526-cabb-4824-8032-031557d158ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:51.150511 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-77716526-cabb-4824-8032-031557d158ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:51.153381 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-77716526-cabb-4824-8032-031557d158ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:51.154198 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-77716526-cabb-4824-8032-031557d158ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:51.154634 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-77716526-cabb-4824-8032-031557d158ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:51.201580 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-bff53d66-25c9-4048-8bae-f1013c352eb3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lazy-loading 'services' on Instance uuid 46d2d343-94b5-4688-84f5-89951c4d4555 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:32:51.507804 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-77716526-cabb-4824-8032-031557d158ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:51.517651 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-77716526-cabb-4824-8032-031557d158ef tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.397777 Aug 24 19:32:51.528498 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 244/486] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:51 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:51.654753 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-bff53d66-25c9-4048-8bae-f1013c352eb3 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "DELETE /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555/os-volume_attachments/2fbafe14-94a7-4a3e-a968-947d632dfdd3" status: 202 len: 0 microversion: 2.1 time: 0.754586 Aug 24 19:32:51.658216 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-66ef3cf8-0b2e-4e97-94e8-4bba5c1e913f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:51.658768 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 243/487] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 24 19:32:50 2021] DELETE /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555/os-volume_attachments/2fbafe14-94a7-4a3e-a968-947d632dfdd3 => generated 0 bytes in 759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:32:51.659683 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-66ef3cf8-0b2e-4e97-94e8-4bba5c1e913f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:51.669164 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-66ef3cf8-0b2e-4e97-94e8-4bba5c1e913f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:51.673108 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-66ef3cf8-0b2e-4e97-94e8-4bba5c1e913f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:51.673231 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ce17fc87-0937-4319-a702-990b26381332 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:51.673320 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-66ef3cf8-0b2e-4e97-94e8-4bba5c1e913f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:51.673477 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ce17fc87-0937-4319-a702-990b26381332 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:51.673730 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-66ef3cf8-0b2e-4e97-94e8-4bba5c1e913f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:51.692370 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ce17fc87-0937-4319-a702-990b26381332 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:51.693125 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ce17fc87-0937-4319-a702-990b26381332 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:51.694109 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ce17fc87-0937-4319-a702-990b26381332 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:51.697875 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ce17fc87-0937-4319-a702-990b26381332 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:51.753664 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ce17fc87-0937-4319-a702-990b26381332 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090457 Aug 24 19:32:51.759610 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 244/488] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:32:51 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:32:51.800090 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0b5d8496-9807-467a-a3c0-58e997375db6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:51.801319 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0b5d8496-9807-467a-a3c0-58e997375db6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:51.810997 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b5d8496-9807-467a-a3c0-58e997375db6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:51.811895 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b5d8496-9807-467a-a3c0-58e997375db6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:51.813627 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b5d8496-9807-467a-a3c0-58e997375db6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:51.814353 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b5d8496-9807-467a-a3c0-58e997375db6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:51.979780 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0b5d8496-9807-467a-a3c0-58e997375db6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:51.989916 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0b5d8496-9807-467a-a3c0-58e997375db6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1274 microversion: 2.1 time: 0.199365 Aug 24 19:32:51.992386 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 245/489] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:51 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:52.035912 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-66ef3cf8-0b2e-4e97-94e8-4bba5c1e913f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:52.036865 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b75a8063-a439-4c22-b6c7-ad31ee365397 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:52.037741 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b75a8063-a439-4c22-b6c7-ad31ee365397 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:52.044716 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b75a8063-a439-4c22-b6c7-ad31ee365397 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:52.050787 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-66ef3cf8-0b2e-4e97-94e8-4bba5c1e913f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:52.051295 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b75a8063-a439-4c22-b6c7-ad31ee365397 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:52.052842 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b75a8063-a439-4c22-b6c7-ad31ee365397 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:52.053278 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b75a8063-a439-4c22-b6c7-ad31ee365397 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:52.056297 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-66ef3cf8-0b2e-4e97-94e8-4bba5c1e913f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:52.057764 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-66ef3cf8-0b2e-4e97-94e8-4bba5c1e913f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.403747 Aug 24 19:32:52.061861 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 245/490] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:51 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:32:52.337176 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b75a8063-a439-4c22-b6c7-ad31ee365397 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:52.368339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b75a8063-a439-4c22-b6c7-ad31ee365397 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1722 microversion: 2.1 time: 0.322808 Aug 24 19:32:52.380287 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 246/491] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:52 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1722 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:52.545685 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-893f3658-2490-48ab-a946-9953ede43ac1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:52.546814 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-893f3658-2490-48ab-a946-9953ede43ac1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:52.557230 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-893f3658-2490-48ab-a946-9953ede43ac1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:52.560714 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-893f3658-2490-48ab-a946-9953ede43ac1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:52.561975 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-893f3658-2490-48ab-a946-9953ede43ac1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:52.562602 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-893f3658-2490-48ab-a946-9953ede43ac1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:52.773608 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0b1b8869-c9d5-4f2f-a0ae-e276ee62bd57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:52.775057 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0b1b8869-c9d5-4f2f-a0ae-e276ee62bd57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:52.781869 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b1b8869-c9d5-4f2f-a0ae-e276ee62bd57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:52.782518 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b1b8869-c9d5-4f2f-a0ae-e276ee62bd57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:52.783721 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b1b8869-c9d5-4f2f-a0ae-e276ee62bd57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:52.784157 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b1b8869-c9d5-4f2f-a0ae-e276ee62bd57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:52.841199 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0b1b8869-c9d5-4f2f-a0ae-e276ee62bd57 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078967 Aug 24 19:32:52.843004 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 247/492] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:32:52 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:32:52.869632 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-893f3658-2490-48ab-a946-9953ede43ac1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:52.883495 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-893f3658-2490-48ab-a946-9953ede43ac1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.347142 Aug 24 19:32:52.886815 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 246/493] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:52 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:53.007774 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-2bf517fb-ff6d-453f-8361-12d245cd5e4d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:53.008358 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-2bf517fb-ff6d-453f-8361-12d245cd5e4d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:53.020184 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2bf517fb-ff6d-453f-8361-12d245cd5e4d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:53.020940 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2bf517fb-ff6d-453f-8361-12d245cd5e4d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:53.022106 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2bf517fb-ff6d-453f-8361-12d245cd5e4d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:53.022701 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2bf517fb-ff6d-453f-8361-12d245cd5e4d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:53.082515 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-62f180be-d2fb-44f9-8c65-d17e8b4c7560 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:53.083168 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-62f180be-d2fb-44f9-8c65-d17e8b4c7560 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:53.090380 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-62f180be-d2fb-44f9-8c65-d17e8b4c7560 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:53.101452 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-62f180be-d2fb-44f9-8c65-d17e8b4c7560 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:53.102542 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-62f180be-d2fb-44f9-8c65-d17e8b4c7560 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:53.103316 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-62f180be-d2fb-44f9-8c65-d17e8b4c7560 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:53.172454 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2bf517fb-ff6d-453f-8361-12d245cd5e4d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:53.187941 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-2bf517fb-ff6d-453f-8361-12d245cd5e4d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1272 microversion: 2.1 time: 0.184581 Aug 24 19:32:53.210473 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 248/494] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:53 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:53.386535 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1cc942f5-d992-4c2d-8b71-9688f746a7e3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:53.387142 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1cc942f5-d992-4c2d-8b71-9688f746a7e3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:53.397885 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1cc942f5-d992-4c2d-8b71-9688f746a7e3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:53.398902 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-62f180be-d2fb-44f9-8c65-d17e8b4c7560 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:53.400907 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1cc942f5-d992-4c2d-8b71-9688f746a7e3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:53.406006 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1cc942f5-d992-4c2d-8b71-9688f746a7e3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:53.411061 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1cc942f5-d992-4c2d-8b71-9688f746a7e3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:53.411997 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-62f180be-d2fb-44f9-8c65-d17e8b4c7560 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:53.413658 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-62f180be-d2fb-44f9-8c65-d17e8b4c7560 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:53.415115 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-62f180be-d2fb-44f9-8c65-d17e8b4c7560 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.336291 Aug 24 19:32:53.415695 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 247/495] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:53 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:32:53.740347 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1cc942f5-d992-4c2d-8b71-9688f746a7e3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:53.744816 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1cc942f5-d992-4c2d-8b71-9688f746a7e3 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1722 microversion: 2.1 time: 0.362748 Aug 24 19:32:53.746573 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 249/496] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:53 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1722 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:53.854452 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4f4f7e6b-780f-4e00-a779-2a84252b70f6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:53.855943 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4f4f7e6b-780f-4e00-a779-2a84252b70f6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:53.866155 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f4f7e6b-780f-4e00-a779-2a84252b70f6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:53.866920 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f4f7e6b-780f-4e00-a779-2a84252b70f6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:53.868593 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f4f7e6b-780f-4e00-a779-2a84252b70f6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:53.869389 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f4f7e6b-780f-4e00-a779-2a84252b70f6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:53.903836 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6aaa1c57-9440-4786-9fb6-6c5e10fdb3ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:53.912942 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6aaa1c57-9440-4786-9fb6-6c5e10fdb3ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:53.931775 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6aaa1c57-9440-4786-9fb6-6c5e10fdb3ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:53.932362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6aaa1c57-9440-4786-9fb6-6c5e10fdb3ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:53.935004 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4f4f7e6b-780f-4e00-a779-2a84252b70f6 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084624 Aug 24 19:32:53.936089 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6aaa1c57-9440-4786-9fb6-6c5e10fdb3ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:53.936674 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6aaa1c57-9440-4786-9fb6-6c5e10fdb3ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:53.944589 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 248/497] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:32:53 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:32:54.208741 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-391d898c-6fac-4733-bc09-bdb2c255a90d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:54.209414 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-391d898c-6fac-4733-bc09-bdb2c255a90d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:54.216064 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-391d898c-6fac-4733-bc09-bdb2c255a90d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:54.217079 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-391d898c-6fac-4733-bc09-bdb2c255a90d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:54.218198 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-391d898c-6fac-4733-bc09-bdb2c255a90d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:54.218873 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-391d898c-6fac-4733-bc09-bdb2c255a90d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:54.260139 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6aaa1c57-9440-4786-9fb6-6c5e10fdb3ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:54.274898 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6aaa1c57-9440-4786-9fb6-6c5e10fdb3ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.375331 Aug 24 19:32:54.282486 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 250/498] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:53 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:54.433143 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-260f193f-8ef9-47ff-a6ca-4286a8848aeb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:54.433764 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-260f193f-8ef9-47ff-a6ca-4286a8848aeb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:54.443078 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-260f193f-8ef9-47ff-a6ca-4286a8848aeb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:54.445923 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-260f193f-8ef9-47ff-a6ca-4286a8848aeb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:54.446871 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-260f193f-8ef9-47ff-a6ca-4286a8848aeb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:54.447228 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-260f193f-8ef9-47ff-a6ca-4286a8848aeb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:54.486209 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-391d898c-6fac-4733-bc09-bdb2c255a90d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:54.497451 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-391d898c-6fac-4733-bc09-bdb2c255a90d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1314 microversion: 2.1 time: 0.294886 Aug 24 19:32:54.506591 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 249/499] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:54 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:54.748491 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-260f193f-8ef9-47ff-a6ca-4286a8848aeb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:54.763513 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f67d8567-adab-4366-b15d-7c16a6a3c69c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:54.763930 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-260f193f-8ef9-47ff-a6ca-4286a8848aeb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:54.764636 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f67d8567-adab-4366-b15d-7c16a6a3c69c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:54.768343 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-260f193f-8ef9-47ff-a6ca-4286a8848aeb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:54.772373 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-260f193f-8ef9-47ff-a6ca-4286a8848aeb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.341978 Aug 24 19:32:54.776361 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 251/500] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:54 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:32:54.782055 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f67d8567-adab-4366-b15d-7c16a6a3c69c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:54.783612 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f67d8567-adab-4366-b15d-7c16a6a3c69c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:54.789161 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f67d8567-adab-4366-b15d-7c16a6a3c69c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:54.790297 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f67d8567-adab-4366-b15d-7c16a6a3c69c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:55.077484 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f67d8567-adab-4366-b15d-7c16a6a3c69c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:55.089609 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f67d8567-adab-4366-b15d-7c16a6a3c69c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1722 microversion: 2.1 time: 0.330320 Aug 24 19:32:55.097001 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 250/501] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:54 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:55.098136 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-c0eddf9e-abc8-44c6-946d-51a4158a6df2 req-b0eba35d-9ea1-437c-86f5-905915f3d293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e820068-00d0-4979-a583-40389d6f3732", "tag": "d7cdfb5c-d751-4ae0-b460-784c797710b3"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:55.100062 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:32:55.100062 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:32:55.110261 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-c0eddf9e-abc8-44c6-946d-51a4158a6df2 req-b0eba35d-9ea1-437c-86f5-905915f3d293 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:55.115398 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-c0eddf9e-abc8-44c6-946d-51a4158a6df2 req-b0eba35d-9ea1-437c-86f5-905915f3d293 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:55.146262 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-c0eddf9e-abc8-44c6-946d-51a4158a6df2 req-b0eba35d-9ea1-437c-86f5-905915f3d293 service nova] Creating event network-changed:d7cdfb5c-d751-4ae0-b460-784c797710b3 for instance 6e820068-00d0-4979-a583-40389d6f3732 on hv-cinder-79819 Aug 24 19:32:55.174958 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-c0eddf9e-abc8-44c6-946d-51a4158a6df2 req-b0eba35d-9ea1-437c-86f5-905915f3d293 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081301 Aug 24 19:32:55.178389 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 252/502] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:32:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:32:55.298734 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-64625396-89ff-4fd0-907c-b100effc1941 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:55.303747 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-64625396-89ff-4fd0-907c-b100effc1941 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:55.310476 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-64625396-89ff-4fd0-907c-b100effc1941 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:55.315800 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-64625396-89ff-4fd0-907c-b100effc1941 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:55.317448 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-64625396-89ff-4fd0-907c-b100effc1941 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:55.321144 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-64625396-89ff-4fd0-907c-b100effc1941 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:55.519296 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ecd90ac4-73a7-4692-8da1-aa24f82ac4b9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:55.520691 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ecd90ac4-73a7-4692-8da1-aa24f82ac4b9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:55.532237 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ecd90ac4-73a7-4692-8da1-aa24f82ac4b9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:55.534940 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ecd90ac4-73a7-4692-8da1-aa24f82ac4b9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:55.541949 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ecd90ac4-73a7-4692-8da1-aa24f82ac4b9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:55.542554 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ecd90ac4-73a7-4692-8da1-aa24f82ac4b9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:55.852131 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-64625396-89ff-4fd0-907c-b100effc1941 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:55.867314 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-64625396-89ff-4fd0-907c-b100effc1941 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.573022 Aug 24 19:32:55.871255 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ecd90ac4-73a7-4692-8da1-aa24f82ac4b9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:55.876036 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 251/503] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:55 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:55.887984 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ecd90ac4-73a7-4692-8da1-aa24f82ac4b9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1314 microversion: 2.1 time: 0.377340 Aug 24 19:32:55.889952 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-44de1c5f-8c59-4fab-b905-8ee47e663ddc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:55.891488 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-44de1c5f-8c59-4fab-b905-8ee47e663ddc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:55.892058 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 253/504] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:55 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:55.904178 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-102db544-eeaa-4f67-a0d2-5186d232c227 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:55.912443 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-102db544-eeaa-4f67-a0d2-5186d232c227 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:55.930273 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-44de1c5f-8c59-4fab-b905-8ee47e663ddc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:55.931260 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-44de1c5f-8c59-4fab-b905-8ee47e663ddc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:55.935041 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-44de1c5f-8c59-4fab-b905-8ee47e663ddc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:55.936000 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-44de1c5f-8c59-4fab-b905-8ee47e663ddc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:55.940428 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-102db544-eeaa-4f67-a0d2-5186d232c227 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:55.942131 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-102db544-eeaa-4f67-a0d2-5186d232c227 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:55.946318 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-102db544-eeaa-4f67-a0d2-5186d232c227 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:55.946769 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-102db544-eeaa-4f67-a0d2-5186d232c227 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:56.014018 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-44de1c5f-8c59-4fab-b905-8ee47e663ddc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Going to try to terminate instance {{(pid=108908) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:32:56.251553 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-102db544-eeaa-4f67-a0d2-5186d232c227 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:56.251553 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-102db544-eeaa-4f67-a0d2-5186d232c227 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:56.253224 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-102db544-eeaa-4f67-a0d2-5186d232c227 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:56.258126 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-102db544-eeaa-4f67-a0d2-5186d232c227 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.364049 Aug 24 19:32:56.260138 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 254/505] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:55 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:56.264839 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-cdb4852e-4e5a-4b2c-85be-7f23a7cce51b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:56.265597 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-cdb4852e-4e5a-4b2c-85be-7f23a7cce51b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:56.302747 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cdb4852e-4e5a-4b2c-85be-7f23a7cce51b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:56.304060 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cdb4852e-4e5a-4b2c-85be-7f23a7cce51b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:56.305109 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cdb4852e-4e5a-4b2c-85be-7f23a7cce51b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:56.305760 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cdb4852e-4e5a-4b2c-85be-7f23a7cce51b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:56.473399 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-44de1c5f-8c59-4fab-b905-8ee47e663ddc tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "DELETE /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 204 len: 0 microversion: 2.1 time: 0.595730 Aug 24 19:32:56.479730 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 252/506] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:32:55 2021] DELETE /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:32:56.484854 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-36db3deb-4e58-41ff-ad2a-efa6d6b334e4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:56.485802 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-36db3deb-4e58-41ff-ad2a-efa6d6b334e4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:56.493306 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-36db3deb-4e58-41ff-ad2a-efa6d6b334e4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:56.494601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-36db3deb-4e58-41ff-ad2a-efa6d6b334e4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:56.509617 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-36db3deb-4e58-41ff-ad2a-efa6d6b334e4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:56.511357 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-36db3deb-4e58-41ff-ad2a-efa6d6b334e4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:56.672360 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-cdb4852e-4e5a-4b2c-85be-7f23a7cce51b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:56.681759 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-cdb4852e-4e5a-4b2c-85be-7f23a7cce51b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1699 microversion: 2.1 time: 0.420307 Aug 24 19:32:56.682364 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 255/507] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:56 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1699 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:56.700945 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ad7c4e7f-6375-484a-99d1-090780f0a852 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:56.708547 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ad7c4e7f-6375-484a-99d1-090780f0a852 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:56.709013 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ad7c4e7f-6375-484a-99d1-090780f0a852 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:56.786385 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ad7c4e7f-6375-484a-99d1-090780f0a852 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Going to try to start instance {{(pid=108907) start /opt/stack/nova/nova/compute/api.py:2637}} Aug 24 19:32:56.832983 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-36db3deb-4e58-41ff-ad2a-efa6d6b334e4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:56.842752 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-36db3deb-4e58-41ff-ad2a-efa6d6b334e4 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1514 microversion: 2.1 time: 0.363160 Aug 24 19:32:56.845636 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 253/508] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:56 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1514 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:56.898377 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f660f7c2-3daf-40b8-af39-b1870b86caf8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:56.899789 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f660f7c2-3daf-40b8-af39-b1870b86caf8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:56.921536 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f660f7c2-3daf-40b8-af39-b1870b86caf8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:56.921536 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f660f7c2-3daf-40b8-af39-b1870b86caf8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:56.922019 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f660f7c2-3daf-40b8-af39-b1870b86caf8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:56.922514 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f660f7c2-3daf-40b8-af39-b1870b86caf8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:57.008157 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ad7c4e7f-6375-484a-99d1-090780f0a852 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 202 len: 0 microversion: 2.1 time: 0.310860 Aug 24 19:32:57.009877 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 256/509] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:32:56 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:32:57.017774 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-af514d78-d7de-4cc8-9ac4-ef2cb07f8e55 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:57.022446 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-af514d78-d7de-4cc8-9ac4-ef2cb07f8e55 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:57.035162 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-af514d78-d7de-4cc8-9ac4-ef2cb07f8e55 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:57.039883 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-af514d78-d7de-4cc8-9ac4-ef2cb07f8e55 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:57.041312 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-af514d78-d7de-4cc8-9ac4-ef2cb07f8e55 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:57.045055 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-af514d78-d7de-4cc8-9ac4-ef2cb07f8e55 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:57.182016 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f660f7c2-3daf-40b8-af39-b1870b86caf8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:57.192461 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f660f7c2-3daf-40b8-af39-b1870b86caf8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.301862 Aug 24 19:32:57.196910 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 254/510] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:56 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:57.211726 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e7eeee0a-782b-46c6-90f9-337d50676148 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:57.212685 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e7eeee0a-782b-46c6-90f9-337d50676148 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:57.223211 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e7eeee0a-782b-46c6-90f9-337d50676148 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:57.232386 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e7eeee0a-782b-46c6-90f9-337d50676148 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:57.236002 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e7eeee0a-782b-46c6-90f9-337d50676148 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:57.238229 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e7eeee0a-782b-46c6-90f9-337d50676148 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:57.295578 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-af514d78-d7de-4cc8-9ac4-ef2cb07f8e55 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:57.305202 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-af514d78-d7de-4cc8-9ac4-ef2cb07f8e55 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1314 microversion: 2.1 time: 0.293731 Aug 24 19:32:57.305803 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 257/511] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:57 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:57.311458 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e6397c8d-2aea-474e-8295-6bf57456d9e6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:57.312216 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e6397c8d-2aea-474e-8295-6bf57456d9e6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:57.319579 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6397c8d-2aea-474e-8295-6bf57456d9e6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:57.320528 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6397c8d-2aea-474e-8295-6bf57456d9e6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:57.322007 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6397c8d-2aea-474e-8295-6bf57456d9e6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:57.322856 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6397c8d-2aea-474e-8295-6bf57456d9e6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:57.619841 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e7eeee0a-782b-46c6-90f9-337d50676148 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:57.630601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e7eeee0a-782b-46c6-90f9-337d50676148 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1708 microversion: 2.1 time: 0.431898 Aug 24 19:32:57.640253 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 255/512] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:57 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1708 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:57.649242 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e6397c8d-2aea-474e-8295-6bf57456d9e6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:57.658021 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e6397c8d-2aea-474e-8295-6bf57456d9e6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:57.659683 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e6397c8d-2aea-474e-8295-6bf57456d9e6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:57.662004 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e6397c8d-2aea-474e-8295-6bf57456d9e6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1743 microversion: 2.20 time: 0.354874 Aug 24 19:32:57.663034 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 258/513] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:57 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1743 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:57.868495 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-7e5ac850-8e3c-4876-807b-0de439fa2d37 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:57.869300 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-7e5ac850-8e3c-4876-807b-0de439fa2d37 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:57.875434 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7e5ac850-8e3c-4876-807b-0de439fa2d37 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:57.876132 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7e5ac850-8e3c-4876-807b-0de439fa2d37 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:57.876975 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7e5ac850-8e3c-4876-807b-0de439fa2d37 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:57.877556 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7e5ac850-8e3c-4876-807b-0de439fa2d37 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:58.113454 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-7e5ac850-8e3c-4876-807b-0de439fa2d37 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:58.120801 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-7e5ac850-8e3c-4876-807b-0de439fa2d37 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1514 microversion: 2.1 time: 0.255876 Aug 24 19:32:58.121382 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 256/514] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:57 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:58.211220 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-91322deb-a0ff-40dd-92f5-7e7d82a8b28d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:58.229726 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-91322deb-a0ff-40dd-92f5-7e7d82a8b28d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:58.229726 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-91322deb-a0ff-40dd-92f5-7e7d82a8b28d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:58.229726 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-91322deb-a0ff-40dd-92f5-7e7d82a8b28d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:58.229726 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-91322deb-a0ff-40dd-92f5-7e7d82a8b28d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:58.230642 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-91322deb-a0ff-40dd-92f5-7e7d82a8b28d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:58.322513 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-207fb1bd-6da7-4cd6-acd8-ee1b1f2d0ad7 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:58.323165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-207fb1bd-6da7-4cd6-acd8-ee1b1f2d0ad7 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:58.329114 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-207fb1bd-6da7-4cd6-acd8-ee1b1f2d0ad7 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:58.329596 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-207fb1bd-6da7-4cd6-acd8-ee1b1f2d0ad7 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:58.330468 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-207fb1bd-6da7-4cd6-acd8-ee1b1f2d0ad7 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:58.330917 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-207fb1bd-6da7-4cd6-acd8-ee1b1f2d0ad7 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:58.353661 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-91322deb-a0ff-40dd-92f5-7e7d82a8b28d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:58.364206 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-91322deb-a0ff-40dd-92f5-7e7d82a8b28d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.156981 Aug 24 19:32:58.372397 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 259/515] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:58 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:58.475006 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-207fb1bd-6da7-4cd6-acd8-ee1b1f2d0ad7 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:58.482371 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-207fb1bd-6da7-4cd6-acd8-ee1b1f2d0ad7 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1314 microversion: 2.1 time: 0.163600 Aug 24 19:32:58.482877 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 257/516] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:58 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:58.647236 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-24b571d1-bc2e-4174-8822-8ca59028b92f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:58.647846 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-24b571d1-bc2e-4174-8822-8ca59028b92f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:58.655646 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-24b571d1-bc2e-4174-8822-8ca59028b92f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:58.656321 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-24b571d1-bc2e-4174-8822-8ca59028b92f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:58.657083 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-24b571d1-bc2e-4174-8822-8ca59028b92f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:58.657521 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-24b571d1-bc2e-4174-8822-8ca59028b92f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:58.689820 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e511bb67-cb16-4ef6-b653-988a7e52f5dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:58.690583 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e511bb67-cb16-4ef6-b653-988a7e52f5dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:58.698649 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e511bb67-cb16-4ef6-b653-988a7e52f5dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:58.699619 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e511bb67-cb16-4ef6-b653-988a7e52f5dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:58.700454 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e511bb67-cb16-4ef6-b653-988a7e52f5dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:58.701080 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e511bb67-cb16-4ef6-b653-988a7e52f5dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:58.954667 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-24b571d1-bc2e-4174-8822-8ca59028b92f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:58.962838 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-24b571d1-bc2e-4174-8822-8ca59028b92f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1708 microversion: 2.1 time: 0.319743 Aug 24 19:32:58.963638 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 260/517] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:58 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1708 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:32:58.983217 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e511bb67-cb16-4ef6-b653-988a7e52f5dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:58.995432 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e511bb67-cb16-4ef6-b653-988a7e52f5dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:58.996998 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e511bb67-cb16-4ef6-b653-988a7e52f5dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:58.998134 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e511bb67-cb16-4ef6-b653-988a7e52f5dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1743 microversion: 2.20 time: 0.312479 Aug 24 19:32:58.998725 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 258/518] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:32:58 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1743 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:32:59.140601 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0f0e8979-be5b-461b-8b57-2b1ef141cd3e tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:59.143539 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0f0e8979-be5b-461b-8b57-2b1ef141cd3e tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:59.148170 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0f0e8979-be5b-461b-8b57-2b1ef141cd3e tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:59.148674 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0f0e8979-be5b-461b-8b57-2b1ef141cd3e tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:59.149467 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0f0e8979-be5b-461b-8b57-2b1ef141cd3e tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:59.149911 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0f0e8979-be5b-461b-8b57-2b1ef141cd3e tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:59.235793 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0f0e8979-be5b-461b-8b57-2b1ef141cd3e tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:59.248009 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0f0e8979-be5b-461b-8b57-2b1ef141cd3e tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1472 microversion: 2.1 time: 0.113283 Aug 24 19:32:59.249339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 261/519] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:59 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1472 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:59.291158 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-bef4827a-a898-4164-bbfd-0c18601626e8 req-dbd9eb2d-75f4-437d-ac6d-7f023a018f5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46d2d343-94b5-4688-84f5-89951c4d4555", "name": "network-vif-deleted", "tag": "2e1e62a7-e029-4686-a6f1-fc643ec5a30d"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:32:59.293623 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:32:59.293623 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:32:59.302374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-bef4827a-a898-4164-bbfd-0c18601626e8 req-dbd9eb2d-75f4-437d-ac6d-7f023a018f5e service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:59.302814 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-bef4827a-a898-4164-bbfd-0c18601626e8 req-dbd9eb2d-75f4-437d-ac6d-7f023a018f5e service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:59.314101 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-bef4827a-a898-4164-bbfd-0c18601626e8 req-dbd9eb2d-75f4-437d-ac6d-7f023a018f5e service nova] Creating event network-vif-deleted:2e1e62a7-e029-4686-a6f1-fc643ec5a30d for instance 46d2d343-94b5-4688-84f5-89951c4d4555 on hv-cinder-79819 Aug 24 19:32:59.319231 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-bef4827a-a898-4164-bbfd-0c18601626e8 req-dbd9eb2d-75f4-437d-ac6d-7f023a018f5e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032057 Aug 24 19:32:59.319825 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 259/520] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:32:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:32:59.383524 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9719361e-c9ad-4fc9-8d60-2e796058146d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:59.384204 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9719361e-c9ad-4fc9-8d60-2e796058146d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:59.395596 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9719361e-c9ad-4fc9-8d60-2e796058146d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:59.396124 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9719361e-c9ad-4fc9-8d60-2e796058146d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:59.397385 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9719361e-c9ad-4fc9-8d60-2e796058146d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:59.401341 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9719361e-c9ad-4fc9-8d60-2e796058146d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:59.501912 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-7bf5d1a9-de80-4607-8be2-23114c82d986 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:59.502664 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-7bf5d1a9-de80-4607-8be2-23114c82d986 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:59.512122 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7bf5d1a9-de80-4607-8be2-23114c82d986 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:59.513106 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7bf5d1a9-de80-4607-8be2-23114c82d986 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:59.515835 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7bf5d1a9-de80-4607-8be2-23114c82d986 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:59.526622 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7bf5d1a9-de80-4607-8be2-23114c82d986 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:59.579736 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9719361e-c9ad-4fc9-8d60-2e796058146d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:59.588739 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9719361e-c9ad-4fc9-8d60-2e796058146d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.210809 Aug 24 19:32:59.591057 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 262/521] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:59 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:59.693187 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-7bf5d1a9-de80-4607-8be2-23114c82d986 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:32:59.700652 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-7bf5d1a9-de80-4607-8be2-23114c82d986 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1314 microversion: 2.1 time: 0.205117 Aug 24 19:32:59.701379 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 260/522] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:59 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:32:59.981587 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b38486e1-9e04-4885-acd0-809f67d59867 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:32:59.982581 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b38486e1-9e04-4885-acd0-809f67d59867 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:32:59.989389 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b38486e1-9e04-4885-acd0-809f67d59867 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:59.989932 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b38486e1-9e04-4885-acd0-809f67d59867 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:32:59.990711 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b38486e1-9e04-4885-acd0-809f67d59867 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:32:59.991137 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b38486e1-9e04-4885-acd0-809f67d59867 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:00.016884 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-74ba5237-8cf1-4bb9-bee6-ab12a576a0e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:00.017742 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-74ba5237-8cf1-4bb9-bee6-ab12a576a0e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:00.024625 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-74ba5237-8cf1-4bb9-bee6-ab12a576a0e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:00.026116 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-74ba5237-8cf1-4bb9-bee6-ab12a576a0e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:00.026116 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-74ba5237-8cf1-4bb9-bee6-ab12a576a0e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:00.026345 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-74ba5237-8cf1-4bb9-bee6-ab12a576a0e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:00.214628 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b38486e1-9e04-4885-acd0-809f67d59867 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:00.227568 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-74ba5237-8cf1-4bb9-bee6-ab12a576a0e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:00.238680 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-74ba5237-8cf1-4bb9-bee6-ab12a576a0e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:00.244923 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-74ba5237-8cf1-4bb9-bee6-ab12a576a0e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:00.244923 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-74ba5237-8cf1-4bb9-bee6-ab12a576a0e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.230033 Aug 24 19:33:00.246872 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 261/523] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:00 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:33:00.249369 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b38486e1-9e04-4885-acd0-809f67d59867 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1712 microversion: 2.1 time: 0.272334 Aug 24 19:33:00.250969 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 263/524] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:32:59 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1712 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:00.288402 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e68f4824-eaef-4b10-9459-e9df66fd1d2a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:00.289593 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e68f4824-eaef-4b10-9459-e9df66fd1d2a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:00.302551 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e68f4824-eaef-4b10-9459-e9df66fd1d2a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:00.306281 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e68f4824-eaef-4b10-9459-e9df66fd1d2a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:00.306281 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e68f4824-eaef-4b10-9459-e9df66fd1d2a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:00.306281 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e68f4824-eaef-4b10-9459-e9df66fd1d2a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:00.343188 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e68f4824-eaef-4b10-9459-e9df66fd1d2a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:00.344130 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e68f4824-eaef-4b10-9459-e9df66fd1d2a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:00.344780 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.objects.instance [None req-e68f4824-eaef-4b10-9459-e9df66fd1d2a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lazy-loading 'fault' on Instance uuid 46d2d343-94b5-4688-84f5-89951c4d4555 {{(pid=108908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:33:00.413516 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e68f4824-eaef-4b10-9459-e9df66fd1d2a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:00.422855 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e68f4824-eaef-4b10-9459-e9df66fd1d2a tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 200 len: 1308 microversion: 2.1 time: 0.141830 Aug 24 19:33:00.428531 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 262/525] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:00 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 1308 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:00.608970 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-382ec5a6-6041-4c0d-855d-fbe89e77397d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:00.613034 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-382ec5a6-6041-4c0d-855d-fbe89e77397d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:00.619376 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-382ec5a6-6041-4c0d-855d-fbe89e77397d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:00.619923 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-382ec5a6-6041-4c0d-855d-fbe89e77397d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:00.620776 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-382ec5a6-6041-4c0d-855d-fbe89e77397d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:00.621210 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-382ec5a6-6041-4c0d-855d-fbe89e77397d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:00.718584 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ef1b38b4-69d7-4804-951c-4fa60cf8ea6a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:00.719296 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ef1b38b4-69d7-4804-951c-4fa60cf8ea6a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:00.725641 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ef1b38b4-69d7-4804-951c-4fa60cf8ea6a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:00.726241 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ef1b38b4-69d7-4804-951c-4fa60cf8ea6a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:00.727529 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ef1b38b4-69d7-4804-951c-4fa60cf8ea6a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:00.728206 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ef1b38b4-69d7-4804-951c-4fa60cf8ea6a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:00.766582 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-382ec5a6-6041-4c0d-855d-fbe89e77397d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:00.784825 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-382ec5a6-6041-4c0d-855d-fbe89e77397d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.180122 Aug 24 19:33:00.785904 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 264/526] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:00 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:00.887224 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ef1b38b4-69d7-4804-951c-4fa60cf8ea6a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:00.896091 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ef1b38b4-69d7-4804-951c-4fa60cf8ea6a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1314 microversion: 2.1 time: 0.181609 Aug 24 19:33:00.897229 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 263/527] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:00 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:01.270861 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-b255709c-7680-4c7b-9c28-b0f6134db0f0 req-d1278035-6556-4356-91d8-69988f521305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c70c776-ec7a-4970-9d9f-baf8c6568257", "name": "network-vif-plugged", "status": "completed", "tag": "39906ad8-eb91-4f23-8e1c-cbdd3d7aa570"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:01.272551 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:01.272551 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:33:01.279803 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-b255709c-7680-4c7b-9c28-b0f6134db0f0 req-d1278035-6556-4356-91d8-69988f521305 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:01.280244 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-b255709c-7680-4c7b-9c28-b0f6134db0f0 req-d1278035-6556-4356-91d8-69988f521305 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:01.292826 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-b255709c-7680-4c7b-9c28-b0f6134db0f0 req-d1278035-6556-4356-91d8-69988f521305 service nova] Creating event network-vif-plugged:39906ad8-eb91-4f23-8e1c-cbdd3d7aa570 for instance 7c70c776-ec7a-4970-9d9f-baf8c6568257 on hv-cinder-79819 Aug 24 19:33:01.297888 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-b255709c-7680-4c7b-9c28-b0f6134db0f0 req-d1278035-6556-4356-91d8-69988f521305 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031717 Aug 24 19:33:01.298563 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 265/528] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:33:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:33:01.321583 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-86e9e756-91f9-4a3a-817c-73d78c0a468e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:01.322413 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-86e9e756-91f9-4a3a-817c-73d78c0a468e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:01.329283 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-86e9e756-91f9-4a3a-817c-73d78c0a468e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:01.329730 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-86e9e756-91f9-4a3a-817c-73d78c0a468e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:01.330578 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-86e9e756-91f9-4a3a-817c-73d78c0a468e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:01.330968 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-86e9e756-91f9-4a3a-817c-73d78c0a468e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:01.443655 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-03bb0950-0e89-4910-9b07-9e23980e72f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:01.444690 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-03bb0950-0e89-4910-9b07-9e23980e72f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 46d2d343-94b5-4688-84f5-89951c4d4555] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:01.456336 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-03bb0950-0e89-4910-9b07-9e23980e72f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:01.457640 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-03bb0950-0e89-4910-9b07-9e23980e72f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:01.458672 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-03bb0950-0e89-4910-9b07-9e23980e72f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:01.461912 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-86e9e756-91f9-4a3a-817c-73d78c0a468e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:01.465485 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-03bb0950-0e89-4910-9b07-9e23980e72f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:01.474136 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-86e9e756-91f9-4a3a-817c-73d78c0a468e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:01.475621 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-86e9e756-91f9-4a3a-817c-73d78c0a468e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:01.476800 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-86e9e756-91f9-4a3a-817c-73d78c0a468e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.159239 Aug 24 19:33:01.477366 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 264/529] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:01 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:01.479736 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-03bb0950-0e89-4910-9b07-9e23980e72f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] HTTP exception thrown: Instance 46d2d343-94b5-4688-84f5-89951c4d4555 could not be found. Aug 24 19:33:01.480554 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-03bb0950-0e89-4910-9b07-9e23980e72f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Returning 404 to user: Instance 46d2d343-94b5-4688-84f5-89951c4d4555 could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:33:01.481435 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-03bb0950-0e89-4910-9b07-9e23980e72f7 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555" status: 404 len: 111 microversion: 2.1 time: 0.043636 Aug 24 19:33:01.482222 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 266/530] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:01 2021] GET /compute/v2.1/servers/46d2d343-94b5-4688-84f5-89951c4d4555 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 19:33:01.802285 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3bd6e71a-16ab-422a-9cac-15f2de4ebf36 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:01.802912 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3bd6e71a-16ab-422a-9cac-15f2de4ebf36 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:01.808802 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3bd6e71a-16ab-422a-9cac-15f2de4ebf36 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:01.809451 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3bd6e71a-16ab-422a-9cac-15f2de4ebf36 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:01.810215 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3bd6e71a-16ab-422a-9cac-15f2de4ebf36 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:01.810810 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3bd6e71a-16ab-422a-9cac-15f2de4ebf36 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:01.915112 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8d45c868-7786-4693-b2eb-b1bbbbaa4dfa tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:01.916012 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8d45c868-7786-4693-b2eb-b1bbbbaa4dfa tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:01.940743 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d45c868-7786-4693-b2eb-b1bbbbaa4dfa tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:01.941478 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d45c868-7786-4693-b2eb-b1bbbbaa4dfa tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:01.942579 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d45c868-7786-4693-b2eb-b1bbbbaa4dfa tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:01.943213 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d45c868-7786-4693-b2eb-b1bbbbaa4dfa tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:01.969592 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3bd6e71a-16ab-422a-9cac-15f2de4ebf36 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:01.980679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3bd6e71a-16ab-422a-9cac-15f2de4ebf36 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.181978 Aug 24 19:33:01.981884 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 265/531] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:01 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:02.088166 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8d45c868-7786-4693-b2eb-b1bbbbaa4dfa tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:02.095755 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8d45c868-7786-4693-b2eb-b1bbbbaa4dfa tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1314 microversion: 2.1 time: 0.186797 Aug 24 19:33:02.102821 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 267/532] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:01 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:02.496646 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b860ca81-7360-43c0-9b40-e193a3cd943e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:02.497284 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b860ca81-7360-43c0-9b40-e193a3cd943e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:02.504448 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b860ca81-7360-43c0-9b40-e193a3cd943e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:02.504919 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b860ca81-7360-43c0-9b40-e193a3cd943e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:02.505727 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b860ca81-7360-43c0-9b40-e193a3cd943e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:02.506165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b860ca81-7360-43c0-9b40-e193a3cd943e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:02.636403 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b860ca81-7360-43c0-9b40-e193a3cd943e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:02.647497 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b860ca81-7360-43c0-9b40-e193a3cd943e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:02.649326 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b860ca81-7360-43c0-9b40-e193a3cd943e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:02.650767 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b860ca81-7360-43c0-9b40-e193a3cd943e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.157897 Aug 24 19:33:02.651726 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 266/533] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:02 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:02.747682 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c27f67b8-47de-4c0b-9991-3887efeccbe5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:02.748247 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c27f67b8-47de-4c0b-9991-3887efeccbe5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:02.755669 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c27f67b8-47de-4c0b-9991-3887efeccbe5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:02.756110 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c27f67b8-47de-4c0b-9991-3887efeccbe5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:02.756925 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c27f67b8-47de-4c0b-9991-3887efeccbe5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:02.757396 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c27f67b8-47de-4c0b-9991-3887efeccbe5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:02.785406 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c27f67b8-47de-4c0b-9991-3887efeccbe5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Going to try to terminate instance {{(pid=108907) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:33:02.998677 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c5f80dee-f5ea-4847-9c0e-1c111481b93d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:02.999462 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-c5f80dee-f5ea-4847-9c0e-1c111481b93d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:03.005975 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c5f80dee-f5ea-4847-9c0e-1c111481b93d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:03.006842 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c5f80dee-f5ea-4847-9c0e-1c111481b93d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:03.007756 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c5f80dee-f5ea-4847-9c0e-1c111481b93d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:03.008292 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c5f80dee-f5ea-4847-9c0e-1c111481b93d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:03.060883 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c27f67b8-47de-4c0b-9991-3887efeccbe5 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "DELETE /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 204 len: 0 microversion: 2.1 time: 0.316427 Aug 24 19:33:03.061780 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 268/534] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:33:02 2021] DELETE /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:33:03.070626 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5b4878ec-b9cf-40e6-ad59-8177afd35e41 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:03.071616 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5b4878ec-b9cf-40e6-ad59-8177afd35e41 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:03.078826 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5b4878ec-b9cf-40e6-ad59-8177afd35e41 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:03.079392 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5b4878ec-b9cf-40e6-ad59-8177afd35e41 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:03.081123 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5b4878ec-b9cf-40e6-ad59-8177afd35e41 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:03.081982 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5b4878ec-b9cf-40e6-ad59-8177afd35e41 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:03.171474 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-c5f80dee-f5ea-4847-9c0e-1c111481b93d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:03.184294 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c5f80dee-f5ea-4847-9c0e-1c111481b93d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.189191 Aug 24 19:33:03.185270 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 267/535] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:02 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:03.198329 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-7545deaa-6452-4e1f-89c8-d863d2d2847d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:03.198984 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-7545deaa-6452-4e1f-89c8-d863d2d2847d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:03.205772 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7545deaa-6452-4e1f-89c8-d863d2d2847d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:03.206830 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7545deaa-6452-4e1f-89c8-d863d2d2847d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:03.207080 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7545deaa-6452-4e1f-89c8-d863d2d2847d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:03.207525 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7545deaa-6452-4e1f-89c8-d863d2d2847d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:03.240921 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5b4878ec-b9cf-40e6-ad59-8177afd35e41 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:03.252318 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5b4878ec-b9cf-40e6-ad59-8177afd35e41 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1512 microversion: 2.1 time: 0.186122 Aug 24 19:33:03.264132 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 269/536] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:03 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:03.349951 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-7545deaa-6452-4e1f-89c8-d863d2d2847d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:03.357606 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-7545deaa-6452-4e1f-89c8-d863d2d2847d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1314 microversion: 2.1 time: 0.163044 Aug 24 19:33:03.358249 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 268/537] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:03 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:03.669214 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-df48304d-93a1-4635-8574-3250fe045422 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:03.669811 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-df48304d-93a1-4635-8574-3250fe045422 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:03.676425 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-df48304d-93a1-4635-8574-3250fe045422 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:03.676875 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-df48304d-93a1-4635-8574-3250fe045422 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:03.677658 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-df48304d-93a1-4635-8574-3250fe045422 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:03.678148 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-df48304d-93a1-4635-8574-3250fe045422 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:03.815048 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-df48304d-93a1-4635-8574-3250fe045422 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:03.828531 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-df48304d-93a1-4635-8574-3250fe045422 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:03.830411 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-df48304d-93a1-4635-8574-3250fe045422 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:03.832025 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-df48304d-93a1-4635-8574-3250fe045422 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.166622 Aug 24 19:33:03.836358 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 270/538] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:03 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:04.202274 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-fa9f02e0-8f49-4310-beb4-2e0949f60a5c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:04.202896 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-fa9f02e0-8f49-4310-beb4-2e0949f60a5c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:04.209944 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fa9f02e0-8f49-4310-beb4-2e0949f60a5c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:04.210398 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fa9f02e0-8f49-4310-beb4-2e0949f60a5c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:04.211216 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fa9f02e0-8f49-4310-beb4-2e0949f60a5c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:04.211654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fa9f02e0-8f49-4310-beb4-2e0949f60a5c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:04.270283 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f3b7f3b5-8156-4542-bbdb-dc965cd991ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:04.271009 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f3b7f3b5-8156-4542-bbdb-dc965cd991ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:04.277448 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f3b7f3b5-8156-4542-bbdb-dc965cd991ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:04.277994 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f3b7f3b5-8156-4542-bbdb-dc965cd991ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:04.278771 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f3b7f3b5-8156-4542-bbdb-dc965cd991ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:04.279192 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f3b7f3b5-8156-4542-bbdb-dc965cd991ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:04.383601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-fa9f02e0-8f49-4310-beb4-2e0949f60a5c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:04.403316 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-fa9f02e0-8f49-4310-beb4-2e0949f60a5c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.204681 Aug 24 19:33:04.412246 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 269/539] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:04 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:04.412246 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1827a142-bfd0-484b-99ef-eb8bcc0c8a6e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:04.412246 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1827a142-bfd0-484b-99ef-eb8bcc0c8a6e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:04.416783 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1827a142-bfd0-484b-99ef-eb8bcc0c8a6e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:04.417231 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1827a142-bfd0-484b-99ef-eb8bcc0c8a6e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:04.418059 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1827a142-bfd0-484b-99ef-eb8bcc0c8a6e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:04.418746 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1827a142-bfd0-484b-99ef-eb8bcc0c8a6e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:04.437924 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f3b7f3b5-8156-4542-bbdb-dc965cd991ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:04.447414 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f3b7f3b5-8156-4542-bbdb-dc965cd991ae tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1512 microversion: 2.1 time: 0.180564 Aug 24 19:33:04.457195 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 271/540] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:04 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:04.545592 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1827a142-bfd0-484b-99ef-eb8bcc0c8a6e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:04.552953 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1827a142-bfd0-484b-99ef-eb8bcc0c8a6e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1314 microversion: 2.1 time: 0.147683 Aug 24 19:33:04.553516 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 270/541] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:04 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:04.851524 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b8c7ac43-2714-4e3e-8073-ceab141f788b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:04.852433 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b8c7ac43-2714-4e3e-8073-ceab141f788b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:04.858756 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8c7ac43-2714-4e3e-8073-ceab141f788b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:04.859272 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8c7ac43-2714-4e3e-8073-ceab141f788b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:04.860146 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8c7ac43-2714-4e3e-8073-ceab141f788b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:04.860669 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8c7ac43-2714-4e3e-8073-ceab141f788b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:05.027645 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-ad07ccd9-d4c7-4797-af77-e20b3600b497 req-74a64e9c-a90d-449f-b67b-98b1f035c2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e820068-00d0-4979-a583-40389d6f3732", "name": "network-vif-plugged", "status": "completed", "tag": "d7cdfb5c-d751-4ae0-b460-784c797710b3"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:05.029668 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:05.029668 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:33:05.037852 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-ad07ccd9-d4c7-4797-af77-e20b3600b497 req-74a64e9c-a90d-449f-b67b-98b1f035c2be service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:05.042157 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-ad07ccd9-d4c7-4797-af77-e20b3600b497 req-74a64e9c-a90d-449f-b67b-98b1f035c2be service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:05.046255 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b8c7ac43-2714-4e3e-8073-ceab141f788b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:05.050599 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-ad07ccd9-d4c7-4797-af77-e20b3600b497 req-74a64e9c-a90d-449f-b67b-98b1f035c2be service nova] Creating event network-vif-plugged:d7cdfb5c-d751-4ae0-b460-784c797710b3 for instance 6e820068-00d0-4979-a583-40389d6f3732 on hv-cinder-79819 Aug 24 19:33:05.055781 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b8c7ac43-2714-4e3e-8073-ceab141f788b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:05.056814 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-ad07ccd9-d4c7-4797-af77-e20b3600b497 req-74a64e9c-a90d-449f-b67b-98b1f035c2be service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034207 Aug 24 19:33:05.057407 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b8c7ac43-2714-4e3e-8073-ceab141f788b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:05.058019 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 271/542] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:33:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:33:05.071524 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b8c7ac43-2714-4e3e-8073-ceab141f788b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.213993 Aug 24 19:33:05.071524 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 272/543] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:04 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:05.421405 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-815cc1db-5804-4b34-8366-6217116f6387 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:05.422435 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-815cc1db-5804-4b34-8366-6217116f6387 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:05.429214 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-815cc1db-5804-4b34-8366-6217116f6387 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:05.429828 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-815cc1db-5804-4b34-8366-6217116f6387 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:05.430657 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-815cc1db-5804-4b34-8366-6217116f6387 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:05.431095 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-815cc1db-5804-4b34-8366-6217116f6387 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:05.465289 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-378ff23f-e5d8-42dc-937b-a32e6b6a449c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:05.466332 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-378ff23f-e5d8-42dc-937b-a32e6b6a449c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:05.476852 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-378ff23f-e5d8-42dc-937b-a32e6b6a449c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:05.477553 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-378ff23f-e5d8-42dc-937b-a32e6b6a449c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:05.478495 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-378ff23f-e5d8-42dc-937b-a32e6b6a449c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:05.479192 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-378ff23f-e5d8-42dc-937b-a32e6b6a449c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:05.610666 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-378ff23f-e5d8-42dc-937b-a32e6b6a449c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:05.618997 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-378ff23f-e5d8-42dc-937b-a32e6b6a449c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1470 microversion: 2.1 time: 0.159525 Aug 24 19:33:05.629274 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 273/544] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:05 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1470 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:05.634261 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ef3e147c-1fd7-4f84-855a-8093c3614bcc tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:05.635107 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ef3e147c-1fd7-4f84-855a-8093c3614bcc tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:05.641397 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ef3e147c-1fd7-4f84-855a-8093c3614bcc tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:05.642111 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ef3e147c-1fd7-4f84-855a-8093c3614bcc tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:05.644318 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ef3e147c-1fd7-4f84-855a-8093c3614bcc tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:05.645122 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ef3e147c-1fd7-4f84-855a-8093c3614bcc tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:05.755122 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-815cc1db-5804-4b34-8366-6217116f6387 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:05.765082 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-815cc1db-5804-4b34-8366-6217116f6387 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.347825 Aug 24 19:33:05.766080 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 272/545] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:05 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:05.771523 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-b90da9d7-3176-4277-8338-d8e4796476fd req-31e712be-653e-49d7-a219-4028a010e715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "554e6201-ec34-45b3-ad25-7eba945122f0", "name": "network-vif-deleted", "tag": "a907cbe7-3847-4d97-9c08-0319637b734f"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:05.773209 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:05.773209 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:33:05.780241 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-b90da9d7-3176-4277-8338-d8e4796476fd req-31e712be-653e-49d7-a219-4028a010e715 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:05.784213 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-b90da9d7-3176-4277-8338-d8e4796476fd req-31e712be-653e-49d7-a219-4028a010e715 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:05.803268 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-b90da9d7-3176-4277-8338-d8e4796476fd req-31e712be-653e-49d7-a219-4028a010e715 service nova] Creating event network-vif-deleted:a907cbe7-3847-4d97-9c08-0319637b734f for instance 554e6201-ec34-45b3-ad25-7eba945122f0 on hv-cinder-79819 Aug 24 19:33:05.808601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-b90da9d7-3176-4277-8338-d8e4796476fd req-31e712be-653e-49d7-a219-4028a010e715 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040923 Aug 24 19:33:05.809458 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 273/546] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:33:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:33:05.832463 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ef3e147c-1fd7-4f84-855a-8093c3614bcc tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:05.844990 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ef3e147c-1fd7-4f84-855a-8093c3614bcc tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1314 microversion: 2.1 time: 0.210762 Aug 24 19:33:05.847427 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 274/547] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:05 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:06.078374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d448c059-31a6-4bfd-bd60-b99423daf640 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:06.079119 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d448c059-31a6-4bfd-bd60-b99423daf640 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:06.085480 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d448c059-31a6-4bfd-bd60-b99423daf640 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:06.085931 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d448c059-31a6-4bfd-bd60-b99423daf640 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:06.086736 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d448c059-31a6-4bfd-bd60-b99423daf640 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:06.087168 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d448c059-31a6-4bfd-bd60-b99423daf640 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:06.219527 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d448c059-31a6-4bfd-bd60-b99423daf640 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:06.228763 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d448c059-31a6-4bfd-bd60-b99423daf640 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:06.230368 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d448c059-31a6-4bfd-bd60-b99423daf640 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:06.231612 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d448c059-31a6-4bfd-bd60-b99423daf640 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.157240 Aug 24 19:33:06.232191 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 274/548] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:06 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:06.645602 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c7c8feb4-2e6e-4fd0-932a-740ec242f44d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:06.647034 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c7c8feb4-2e6e-4fd0-932a-740ec242f44d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:06.661936 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7c8feb4-2e6e-4fd0-932a-740ec242f44d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:06.662676 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7c8feb4-2e6e-4fd0-932a-740ec242f44d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:06.665796 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7c8feb4-2e6e-4fd0-932a-740ec242f44d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:06.665796 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7c8feb4-2e6e-4fd0-932a-740ec242f44d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:06.717576 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7c8feb4-2e6e-4fd0-932a-740ec242f44d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:06.718309 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7c8feb4-2e6e-4fd0-932a-740ec242f44d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:06.718929 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-c7c8feb4-2e6e-4fd0-932a-740ec242f44d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lazy-loading 'fault' on Instance uuid 554e6201-ec34-45b3-ad25-7eba945122f0 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:33:06.767778 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c7c8feb4-2e6e-4fd0-932a-740ec242f44d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:06.776763 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c7c8feb4-2e6e-4fd0-932a-740ec242f44d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 200 len: 1307 microversion: 2.1 time: 0.135513 Aug 24 19:33:06.790843 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4c86f387-07f3-4459-b174-7c3efa1300c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:06.799630 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4c86f387-07f3-4459-b174-7c3efa1300c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:06.804158 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 275/549] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:06 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 1307 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:06.808554 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4c86f387-07f3-4459-b174-7c3efa1300c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:06.809060 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4c86f387-07f3-4459-b174-7c3efa1300c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:06.810021 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4c86f387-07f3-4459-b174-7c3efa1300c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:06.811169 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4c86f387-07f3-4459-b174-7c3efa1300c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:06.861764 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b9b6f4b4-8921-4bb9-adc2-b923d25efb6c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:06.862507 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b9b6f4b4-8921-4bb9-adc2-b923d25efb6c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:06.871574 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b9b6f4b4-8921-4bb9-adc2-b923d25efb6c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:06.872402 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b9b6f4b4-8921-4bb9-adc2-b923d25efb6c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:06.873543 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b9b6f4b4-8921-4bb9-adc2-b923d25efb6c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:06.874254 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b9b6f4b4-8921-4bb9-adc2-b923d25efb6c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:07.150753 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b9b6f4b4-8921-4bb9-adc2-b923d25efb6c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:07.161991 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b9b6f4b4-8921-4bb9-adc2-b923d25efb6c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1314 microversion: 2.1 time: 0.303679 Aug 24 19:33:07.162818 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 276/550] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:06 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:07.175272 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4c86f387-07f3-4459-b174-7c3efa1300c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:07.185889 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4c86f387-07f3-4459-b174-7c3efa1300c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.399185 Aug 24 19:33:07.196788 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 275/551] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:06 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:07.253447 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-afa3a5dc-908d-43aa-a611-6bb80c0293f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:07.254154 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-afa3a5dc-908d-43aa-a611-6bb80c0293f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:07.260483 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-afa3a5dc-908d-43aa-a611-6bb80c0293f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:07.261047 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-afa3a5dc-908d-43aa-a611-6bb80c0293f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:07.261886 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-afa3a5dc-908d-43aa-a611-6bb80c0293f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:07.262810 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-afa3a5dc-908d-43aa-a611-6bb80c0293f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:07.427005 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-afa3a5dc-908d-43aa-a611-6bb80c0293f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:07.435259 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-afa3a5dc-908d-43aa-a611-6bb80c0293f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:07.439284 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-afa3a5dc-908d-43aa-a611-6bb80c0293f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:07.441482 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-afa3a5dc-908d-43aa-a611-6bb80c0293f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.193790 Aug 24 19:33:07.445945 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 277/552] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:07 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:07.796743 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f8de4a2a-495e-4787-b6e1-bcd27cf7eb97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:07.798143 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f8de4a2a-495e-4787-b6e1-bcd27cf7eb97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 554e6201-ec34-45b3-ad25-7eba945122f0] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:07.807424 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f8de4a2a-495e-4787-b6e1-bcd27cf7eb97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:07.808024 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f8de4a2a-495e-4787-b6e1-bcd27cf7eb97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:07.808840 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f8de4a2a-495e-4787-b6e1-bcd27cf7eb97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:07.809272 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f8de4a2a-495e-4787-b6e1-bcd27cf7eb97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:07.825164 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-f8de4a2a-495e-4787-b6e1-bcd27cf7eb97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] HTTP exception thrown: Instance 554e6201-ec34-45b3-ad25-7eba945122f0 could not be found. Aug 24 19:33:07.826339 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f8de4a2a-495e-4787-b6e1-bcd27cf7eb97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Returning 404 to user: Instance 554e6201-ec34-45b3-ad25-7eba945122f0 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:33:07.827401 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f8de4a2a-495e-4787-b6e1-bcd27cf7eb97 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0" status: 404 len: 111 microversion: 2.1 time: 0.037134 Aug 24 19:33:07.828200 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 276/553] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:07 2021] GET /compute/v2.1/servers/554e6201-ec34-45b3-ad25-7eba945122f0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:33:07.838758 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c59ac731-d217-4a4e-8a91-c3e7fb7fa57c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:07.839444 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c59ac731-d217-4a4e-8a91-c3e7fb7fa57c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:07.846269 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c59ac731-d217-4a4e-8a91-c3e7fb7fa57c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:07.846763 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c59ac731-d217-4a4e-8a91-c3e7fb7fa57c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:07.847519 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c59ac731-d217-4a4e-8a91-c3e7fb7fa57c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:07.847939 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c59ac731-d217-4a4e-8a91-c3e7fb7fa57c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:07.875985 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c59ac731-d217-4a4e-8a91-c3e7fb7fa57c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Going to try to terminate instance {{(pid=108907) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:33:08.181906 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e3857f85-b00a-4073-b266-96fbda23a725 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:08.182836 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e3857f85-b00a-4073-b266-96fbda23a725 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:08.191723 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3857f85-b00a-4073-b266-96fbda23a725 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:08.192178 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3857f85-b00a-4073-b266-96fbda23a725 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:08.193010 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3857f85-b00a-4073-b266-96fbda23a725 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:08.193444 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3857f85-b00a-4073-b266-96fbda23a725 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:08.335095 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e3857f85-b00a-4073-b266-96fbda23a725 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:08.342931 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e3857f85-b00a-4073-b266-96fbda23a725 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1498 microversion: 2.1 time: 0.166368 Aug 24 19:33:08.343815 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 277/554] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:08 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:08.351791 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-45e3a063-d30d-45fd-84ae-18bd5656f758 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:08.352533 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-45e3a063-d30d-45fd-84ae-18bd5656f758 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:08.359391 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-45e3a063-d30d-45fd-84ae-18bd5656f758 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:08.376178 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-45e3a063-d30d-45fd-84ae-18bd5656f758 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:08.377497 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-45e3a063-d30d-45fd-84ae-18bd5656f758 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:08.378519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-45e3a063-d30d-45fd-84ae-18bd5656f758 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:08.565382 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-45e3a063-d30d-45fd-84ae-18bd5656f758 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:08.573726 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-45e3a063-d30d-45fd-84ae-18bd5656f758 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.225970 Aug 24 19:33:08.574300 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 278/555] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:08 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:08.578746 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-fd7d126a-adbb-4407-970f-2da726e2ae02 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:08.579346 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-fd7d126a-adbb-4407-970f-2da726e2ae02 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:08.592955 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fd7d126a-adbb-4407-970f-2da726e2ae02 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:08.595448 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fd7d126a-adbb-4407-970f-2da726e2ae02 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:08.595448 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fd7d126a-adbb-4407-970f-2da726e2ae02 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:08.595448 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fd7d126a-adbb-4407-970f-2da726e2ae02 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:08.665775 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c59ac731-d217-4a4e-8a91-c3e7fb7fa57c tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 204 len: 0 microversion: 2.1 time: 0.831953 Aug 24 19:33:08.666911 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 278/556] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:33:07 2021] DELETE /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 0 bytes in 834 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:33:08.675900 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f7038b2d-c6fb-421e-9997-ac2da11d3e73 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:08.676643 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f7038b2d-c6fb-421e-9997-ac2da11d3e73 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:08.684857 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f7038b2d-c6fb-421e-9997-ac2da11d3e73 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:08.685299 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f7038b2d-c6fb-421e-9997-ac2da11d3e73 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:08.686144 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f7038b2d-c6fb-421e-9997-ac2da11d3e73 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:08.686572 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f7038b2d-c6fb-421e-9997-ac2da11d3e73 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:08.797231 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-fd7d126a-adbb-4407-970f-2da726e2ae02 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:08.810110 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-fd7d126a-adbb-4407-970f-2da726e2ae02 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:08.812150 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-fd7d126a-adbb-4407-970f-2da726e2ae02 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:08.813402 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-fd7d126a-adbb-4407-970f-2da726e2ae02 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.238119 Aug 24 19:33:08.814204 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 279/557] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:08 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:08.881222 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f7038b2d-c6fb-421e-9997-ac2da11d3e73 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:08.889437 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f7038b2d-c6fb-421e-9997-ac2da11d3e73 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1513 microversion: 2.1 time: 0.217637 Aug 24 19:33:08.900997 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 279/558] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:08 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1513 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:09.592812 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-7a86ca68-3e62-4e58-b025-f127c57ce1a1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:09.593713 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-7a86ca68-3e62-4e58-b025-f127c57ce1a1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:09.604664 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7a86ca68-3e62-4e58-b025-f127c57ce1a1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:09.604664 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7a86ca68-3e62-4e58-b025-f127c57ce1a1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:09.604664 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7a86ca68-3e62-4e58-b025-f127c57ce1a1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:09.604664 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7a86ca68-3e62-4e58-b025-f127c57ce1a1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:09.723628 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-25c81a31-45f0-49ca-88c4-07cb48629be9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:09.724108 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-25c81a31-45f0-49ca-88c4-07cb48629be9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:09.730542 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-25c81a31-45f0-49ca-88c4-07cb48629be9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:09.730984 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-25c81a31-45f0-49ca-88c4-07cb48629be9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:09.731780 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-25c81a31-45f0-49ca-88c4-07cb48629be9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:09.732738 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-25c81a31-45f0-49ca-88c4-07cb48629be9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:09.766710 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-7a86ca68-3e62-4e58-b025-f127c57ce1a1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:09.769480 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-25c81a31-45f0-49ca-88c4-07cb48629be9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Going to try to terminate instance {{(pid=108907) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:33:09.776579 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-7a86ca68-3e62-4e58-b025-f127c57ce1a1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.189082 Aug 24 19:33:09.778085 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 280/559] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:09 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:09.832014 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8bbfc0ce-9aa2-4095-b12b-ac0525552e08 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:09.832014 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8bbfc0ce-9aa2-4095-b12b-ac0525552e08 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:09.838222 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8bbfc0ce-9aa2-4095-b12b-ac0525552e08 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:09.838903 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8bbfc0ce-9aa2-4095-b12b-ac0525552e08 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:09.839798 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8bbfc0ce-9aa2-4095-b12b-ac0525552e08 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:09.840225 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8bbfc0ce-9aa2-4095-b12b-ac0525552e08 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:10.031772 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8bbfc0ce-9aa2-4095-b12b-ac0525552e08 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:10.042012 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8bbfc0ce-9aa2-4095-b12b-ac0525552e08 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:10.043671 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8bbfc0ce-9aa2-4095-b12b-ac0525552e08 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:10.045822 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8bbfc0ce-9aa2-4095-b12b-ac0525552e08 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.218634 Aug 24 19:33:10.047915 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 281/560] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:09 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:33:10.052511 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a2b1db59-bc19-4ad0-999b-e1f641800c76 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:10.053412 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a2b1db59-bc19-4ad0-999b-e1f641800c76 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:10.060639 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a2b1db59-bc19-4ad0-999b-e1f641800c76 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:10.061214 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a2b1db59-bc19-4ad0-999b-e1f641800c76 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:10.062267 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a2b1db59-bc19-4ad0-999b-e1f641800c76 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:10.062767 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a2b1db59-bc19-4ad0-999b-e1f641800c76 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:10.169558 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-25c81a31-45f0-49ca-88c4-07cb48629be9 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 204 len: 0 microversion: 2.1 time: 0.449141 Aug 24 19:33:10.170132 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 280/561] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:33:09 2021] DELETE /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:33:10.185607 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-11df4ec9-df69-43fe-a207-6ac5b36929ea tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:10.186688 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-11df4ec9-df69-43fe-a207-6ac5b36929ea tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:10.197829 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-11df4ec9-df69-43fe-a207-6ac5b36929ea tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:10.198554 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-11df4ec9-df69-43fe-a207-6ac5b36929ea tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:10.199966 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-11df4ec9-df69-43fe-a207-6ac5b36929ea tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:10.200857 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-11df4ec9-df69-43fe-a207-6ac5b36929ea tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:10.412794 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a2b1db59-bc19-4ad0-999b-e1f641800c76 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:10.430044 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a2b1db59-bc19-4ad0-999b-e1f641800c76 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1513 microversion: 2.1 time: 0.382151 Aug 24 19:33:10.439288 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 282/562] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:10 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1513 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:10.483842 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-11df4ec9-df69-43fe-a207-6ac5b36929ea tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:10.493727 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-11df4ec9-df69-43fe-a207-6ac5b36929ea tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1504 microversion: 2.1 time: 0.319264 Aug 24 19:33:10.494681 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 281/563] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:10 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1504 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:10.797372 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-895002fc-31f1-43cc-a730-282a9b9b21a6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:10.797987 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-895002fc-31f1-43cc-a730-282a9b9b21a6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:10.804559 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-895002fc-31f1-43cc-a730-282a9b9b21a6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:10.804559 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-895002fc-31f1-43cc-a730-282a9b9b21a6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:10.806125 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-895002fc-31f1-43cc-a730-282a9b9b21a6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:10.806125 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-895002fc-31f1-43cc-a730-282a9b9b21a6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:11.037569 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-4a74c119-a8c5-4f27-9623-56ea94267d04 req-332d3ad6-9836-4822-b845-77e423050048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9dc0dd-298e-4b3f-8117-338c6322ecda", "name": "network-vif-deleted", "tag": "882519cf-19ed-487a-b2db-37296318380e"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:11.039389 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:11.039389 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:33:11.048711 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-4a74c119-a8c5-4f27-9623-56ea94267d04 req-332d3ad6-9836-4822-b845-77e423050048 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:11.051779 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-4a74c119-a8c5-4f27-9623-56ea94267d04 req-332d3ad6-9836-4822-b845-77e423050048 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:11.073882 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-4a74c119-a8c5-4f27-9623-56ea94267d04 req-332d3ad6-9836-4822-b845-77e423050048 service nova] Creating event network-vif-deleted:882519cf-19ed-487a-b2db-37296318380e for instance 9f9dc0dd-298e-4b3f-8117-338c6322ecda on hv-cinder-79819 Aug 24 19:33:11.105095 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-4a74c119-a8c5-4f27-9623-56ea94267d04 req-332d3ad6-9836-4822-b845-77e423050048 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071383 Aug 24 19:33:11.105724 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 282/564] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:33:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:33:11.111013 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e7adca58-2656-47a1-b964-a8f47312aafe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:11.112464 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e7adca58-2656-47a1-b964-a8f47312aafe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:11.125742 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e7adca58-2656-47a1-b964-a8f47312aafe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:11.126330 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e7adca58-2656-47a1-b964-a8f47312aafe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:11.127122 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e7adca58-2656-47a1-b964-a8f47312aafe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:11.128139 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e7adca58-2656-47a1-b964-a8f47312aafe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:11.170058 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-895002fc-31f1-43cc-a730-282a9b9b21a6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:11.179022 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-895002fc-31f1-43cc-a730-282a9b9b21a6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.385246 Aug 24 19:33:11.184601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 283/565] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:10 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:11.305367 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e7adca58-2656-47a1-b964-a8f47312aafe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:11.316020 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e7adca58-2656-47a1-b964-a8f47312aafe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:11.317972 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e7adca58-2656-47a1-b964-a8f47312aafe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:11.319379 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e7adca58-2656-47a1-b964-a8f47312aafe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.212546 Aug 24 19:33:11.320331 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 283/566] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:11 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:11.446874 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a0faf824-9bf8-474e-b236-7f10c3a5139b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:11.447487 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a0faf824-9bf8-474e-b236-7f10c3a5139b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:11.463930 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a0faf824-9bf8-474e-b236-7f10c3a5139b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:11.471175 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a0faf824-9bf8-474e-b236-7f10c3a5139b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:11.471175 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a0faf824-9bf8-474e-b236-7f10c3a5139b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:11.471175 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a0faf824-9bf8-474e-b236-7f10c3a5139b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:11.511064 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-145fd590-a513-493e-ac2a-0be3dfcfa74f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:11.512159 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-145fd590-a513-493e-ac2a-0be3dfcfa74f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:11.516560 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a0faf824-9bf8-474e-b236-7f10c3a5139b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:11.517203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a0faf824-9bf8-474e-b236-7f10c3a5139b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:11.517854 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.objects.instance [None req-a0faf824-9bf8-474e-b236-7f10c3a5139b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lazy-loading 'fault' on Instance uuid 9f9dc0dd-298e-4b3f-8117-338c6322ecda {{(pid=108908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:33:11.523978 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-145fd590-a513-493e-ac2a-0be3dfcfa74f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:11.524614 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-145fd590-a513-493e-ac2a-0be3dfcfa74f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:11.526496 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-145fd590-a513-493e-ac2a-0be3dfcfa74f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:11.527037 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-145fd590-a513-493e-ac2a-0be3dfcfa74f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:11.566489 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a0faf824-9bf8-474e-b236-7f10c3a5139b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:11.577511 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a0faf824-9bf8-474e-b236-7f10c3a5139b tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1308 microversion: 2.1 time: 0.134137 Aug 24 19:33:11.578735 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 284/567] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:11 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1308 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:11.750423 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-145fd590-a513-493e-ac2a-0be3dfcfa74f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:11.760746 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-145fd590-a513-493e-ac2a-0be3dfcfa74f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1504 microversion: 2.1 time: 0.252963 Aug 24 19:33:11.761463 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 284/568] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:11 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:12.205484 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-dbbc17fb-9396-4f4b-bff4-c8c48519a9e8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:12.207403 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-dbbc17fb-9396-4f4b-bff4-c8c48519a9e8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:12.225845 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dbbc17fb-9396-4f4b-bff4-c8c48519a9e8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:12.227402 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dbbc17fb-9396-4f4b-bff4-c8c48519a9e8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:12.228362 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dbbc17fb-9396-4f4b-bff4-c8c48519a9e8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:12.229959 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dbbc17fb-9396-4f4b-bff4-c8c48519a9e8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:12.338906 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-683dd8ef-3a4a-4ba2-82c9-aefd984c29ba tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:12.339796 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-683dd8ef-3a4a-4ba2-82c9-aefd984c29ba tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:12.356572 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-683dd8ef-3a4a-4ba2-82c9-aefd984c29ba tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:12.359218 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-683dd8ef-3a4a-4ba2-82c9-aefd984c29ba tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:12.360594 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-683dd8ef-3a4a-4ba2-82c9-aefd984c29ba tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:12.361268 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-683dd8ef-3a4a-4ba2-82c9-aefd984c29ba tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:12.503494 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-dbbc17fb-9396-4f4b-bff4-c8c48519a9e8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:12.513590 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-dbbc17fb-9396-4f4b-bff4-c8c48519a9e8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.318688 Aug 24 19:33:12.525076 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 285/569] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:12 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:12.596080 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3dd56ddb-3f01-49cf-b5ac-2a3e77d36eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:12.598990 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3dd56ddb-3f01-49cf-b5ac-2a3e77d36eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:12.617494 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3dd56ddb-3f01-49cf-b5ac-2a3e77d36eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:12.621814 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3dd56ddb-3f01-49cf-b5ac-2a3e77d36eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:12.622832 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3dd56ddb-3f01-49cf-b5ac-2a3e77d36eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:12.624646 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3dd56ddb-3f01-49cf-b5ac-2a3e77d36eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:12.644879 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-683dd8ef-3a4a-4ba2-82c9-aefd984c29ba tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:12.653372 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-683dd8ef-3a4a-4ba2-82c9-aefd984c29ba tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:12.661496 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-683dd8ef-3a4a-4ba2-82c9-aefd984c29ba tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:12.662996 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-683dd8ef-3a4a-4ba2-82c9-aefd984c29ba tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.328035 Aug 24 19:33:12.667152 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 285/570] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:12 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:33:12.683573 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3dd56ddb-3f01-49cf-b5ac-2a3e77d36eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:12.684033 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3dd56ddb-3f01-49cf-b5ac-2a3e77d36eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:12.684860 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.objects.instance [None req-3dd56ddb-3f01-49cf-b5ac-2a3e77d36eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lazy-loading 'fault' on Instance uuid 9f9dc0dd-298e-4b3f-8117-338c6322ecda {{(pid=108908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:33:12.779956 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f0c1dddd-2af1-44f1-be5a-2bc14804ebca tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:12.779956 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f0c1dddd-2af1-44f1-be5a-2bc14804ebca tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:12.793116 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0c1dddd-2af1-44f1-be5a-2bc14804ebca tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:12.793560 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0c1dddd-2af1-44f1-be5a-2bc14804ebca tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:12.794359 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0c1dddd-2af1-44f1-be5a-2bc14804ebca tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:12.794785 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0c1dddd-2af1-44f1-be5a-2bc14804ebca tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:12.808879 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3dd56ddb-3f01-49cf-b5ac-2a3e77d36eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:12.844739 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3dd56ddb-3f01-49cf-b5ac-2a3e77d36eeb tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 200 len: 1308 microversion: 2.1 time: 0.252827 Aug 24 19:33:12.857186 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 286/571] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:12 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 1308 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:12.952909 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f0c1dddd-2af1-44f1-be5a-2bc14804ebca tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:12.969334 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f0c1dddd-2af1-44f1-be5a-2bc14804ebca tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1462 microversion: 2.1 time: 0.192853 Aug 24 19:33:12.970574 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 286/572] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:12 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1462 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:13.128218 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-1a88ba0c-22d8-44a0-bc5d-daf230e6ffa5 req-a384bfb4-69ea-4e8c-bad8-63cf05393a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e820068-00d0-4979-a583-40389d6f3732", "name": "network-vif-deleted", "tag": "d7cdfb5c-d751-4ae0-b460-784c797710b3"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:13.131528 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:13.131528 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:33:13.141193 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-1a88ba0c-22d8-44a0-bc5d-daf230e6ffa5 req-a384bfb4-69ea-4e8c-bad8-63cf05393a0f service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:13.142059 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-1a88ba0c-22d8-44a0-bc5d-daf230e6ffa5 req-a384bfb4-69ea-4e8c-bad8-63cf05393a0f service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:13.159266 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-1a88ba0c-22d8-44a0-bc5d-daf230e6ffa5 req-a384bfb4-69ea-4e8c-bad8-63cf05393a0f service nova] Creating event network-vif-deleted:d7cdfb5c-d751-4ae0-b460-784c797710b3 for instance 6e820068-00d0-4979-a583-40389d6f3732 on hv-cinder-79819 Aug 24 19:33:13.167537 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-1a88ba0c-22d8-44a0-bc5d-daf230e6ffa5 req-a384bfb4-69ea-4e8c-bad8-63cf05393a0f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043086 Aug 24 19:33:13.168344 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 287/573] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:33:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:33:13.532338 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e6494f07-ee15-454e-99b2-937a799e6cfa tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:13.534995 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e6494f07-ee15-454e-99b2-937a799e6cfa tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:13.544183 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6494f07-ee15-454e-99b2-937a799e6cfa tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:13.544887 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6494f07-ee15-454e-99b2-937a799e6cfa tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:13.555286 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6494f07-ee15-454e-99b2-937a799e6cfa tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:13.556318 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e6494f07-ee15-454e-99b2-937a799e6cfa tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:13.686434 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9b1a0849-73b6-4081-8c56-1427b2dce56b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:13.687129 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9b1a0849-73b6-4081-8c56-1427b2dce56b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:13.694065 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9b1a0849-73b6-4081-8c56-1427b2dce56b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:13.696311 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9b1a0849-73b6-4081-8c56-1427b2dce56b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:13.699667 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9b1a0849-73b6-4081-8c56-1427b2dce56b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:13.700127 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9b1a0849-73b6-4081-8c56-1427b2dce56b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:13.865123 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e6494f07-ee15-454e-99b2-937a799e6cfa tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:13.874384 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e6494f07-ee15-454e-99b2-937a799e6cfa tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1566 microversion: 2.1 time: 0.347071 Aug 24 19:33:13.884554 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 287/574] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:13 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1566 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:13.884554 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fa88d447-0da3-4b1e-9c93-15c09190bf55 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:13.884554 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fa88d447-0da3-4b1e-9c93-15c09190bf55 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: 9f9dc0dd-298e-4b3f-8117-338c6322ecda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:13.889391 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fa88d447-0da3-4b1e-9c93-15c09190bf55 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:13.889391 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fa88d447-0da3-4b1e-9c93-15c09190bf55 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:13.890121 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fa88d447-0da3-4b1e-9c93-15c09190bf55 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:13.890658 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fa88d447-0da3-4b1e-9c93-15c09190bf55 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:13.919715 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-fa88d447-0da3-4b1e-9c93-15c09190bf55 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] HTTP exception thrown: Instance 9f9dc0dd-298e-4b3f-8117-338c6322ecda could not be found. Aug 24 19:33:13.925795 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fa88d447-0da3-4b1e-9c93-15c09190bf55 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Returning 404 to user: Instance 9f9dc0dd-298e-4b3f-8117-338c6322ecda could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:33:13.928480 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-fa88d447-0da3-4b1e-9c93-15c09190bf55 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda" status: 404 len: 111 microversion: 2.1 time: 0.050464 Aug 24 19:33:13.934885 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 288/575] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:13 2021] GET /compute/v2.1/servers/9f9dc0dd-298e-4b3f-8117-338c6322ecda => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:33:13.960361 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9b1a0849-73b6-4081-8c56-1427b2dce56b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:13.972075 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9b1a0849-73b6-4081-8c56-1427b2dce56b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:13.979611 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9b1a0849-73b6-4081-8c56-1427b2dce56b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:13.983088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9b1a0849-73b6-4081-8c56-1427b2dce56b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.301014 Aug 24 19:33:13.983982 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 288/576] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:13 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:13.995914 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8aab7dbd-f30d-4b87-ad5e-46278eb23007 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:13.998124 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8aab7dbd-f30d-4b87-ad5e-46278eb23007 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:14.010222 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8aab7dbd-f30d-4b87-ad5e-46278eb23007 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:14.010671 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8aab7dbd-f30d-4b87-ad5e-46278eb23007 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:14.011670 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8aab7dbd-f30d-4b87-ad5e-46278eb23007 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:14.012294 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8aab7dbd-f30d-4b87-ad5e-46278eb23007 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:14.093157 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8aab7dbd-f30d-4b87-ad5e-46278eb23007 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:14.094782 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8aab7dbd-f30d-4b87-ad5e-46278eb23007 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:14.096479 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-8aab7dbd-f30d-4b87-ad5e-46278eb23007 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lazy-loading 'fault' on Instance uuid 6e820068-00d0-4979-a583-40389d6f3732 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:33:14.182985 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8aab7dbd-f30d-4b87-ad5e-46278eb23007 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:14.193319 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8aab7dbd-f30d-4b87-ad5e-46278eb23007 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 200 len: 1304 microversion: 2.1 time: 0.210126 Aug 24 19:33:14.194538 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 289/577] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:13 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 1304 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:14.898162 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6f18665f-ee50-4dea-bef0-0692eb0d3d53 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:14.898888 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6f18665f-ee50-4dea-bef0-0692eb0d3d53 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:14.908499 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6f18665f-ee50-4dea-bef0-0692eb0d3d53 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:14.912039 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6f18665f-ee50-4dea-bef0-0692eb0d3d53 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:14.914203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6f18665f-ee50-4dea-bef0-0692eb0d3d53 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:14.916437 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6f18665f-ee50-4dea-bef0-0692eb0d3d53 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:15.005092 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a7e98c93-f70a-42b1-9519-47912243d7b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:15.006353 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a7e98c93-f70a-42b1-9519-47912243d7b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:15.015695 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a7e98c93-f70a-42b1-9519-47912243d7b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:15.018177 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a7e98c93-f70a-42b1-9519-47912243d7b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:15.021283 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a7e98c93-f70a-42b1-9519-47912243d7b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:15.022048 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a7e98c93-f70a-42b1-9519-47912243d7b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:15.133975 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6f18665f-ee50-4dea-bef0-0692eb0d3d53 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:15.145496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6f18665f-ee50-4dea-bef0-0692eb0d3d53 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1546 microversion: 2.1 time: 0.251609 Aug 24 19:33:15.146624 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 289/578] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:14 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1546 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:15.167095 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-98872ccd-c264-4172-bb6b-57dd09e91a65 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:15.167999 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-98872ccd-c264-4172-bb6b-57dd09e91a65 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:15.180937 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-98872ccd-c264-4172-bb6b-57dd09e91a65 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:15.181866 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-98872ccd-c264-4172-bb6b-57dd09e91a65 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:15.183205 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-98872ccd-c264-4172-bb6b-57dd09e91a65 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:15.183863 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-98872ccd-c264-4172-bb6b-57dd09e91a65 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:15.364399 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a7e98c93-f70a-42b1-9519-47912243d7b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:15.388611 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a7e98c93-f70a-42b1-9519-47912243d7b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:15.390638 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a7e98c93-f70a-42b1-9519-47912243d7b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:15.410461 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-98872ccd-c264-4172-bb6b-57dd09e91a65 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] HTTP exception thrown: Cannot 'detach_volume' instance 649b4ff1-abbd-4ccb-8b5a-9ba24f560372 while it is in vm_state rescued Aug 24 19:33:15.411277 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-98872ccd-c264-4172-bb6b-57dd09e91a65 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Returning 409 to user: Cannot 'detach_volume' instance 649b4ff1-abbd-4ccb-8b5a-9ba24f560372 while it is in vm_state rescued {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:33:15.412683 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a7e98c93-f70a-42b1-9519-47912243d7b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.411971 Aug 24 19:33:15.413552 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 290/579] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:14 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:15.414477 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-98872ccd-c264-4172-bb6b-57dd09e91a65 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "DELETE /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/os-volume_attachments/aed80476-d091-4a6a-a51e-3a5b31aa7db2" status: 409 len: 152 microversion: 2.1 time: 0.251448 Aug 24 19:33:15.415469 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 290/580] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 24 19:33:15 2021] DELETE /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/os-volume_attachments/aed80476-d091-4a6a-a51e-3a5b31aa7db2 => generated 152 bytes in 253 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 24 19:33:15.428325 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-30a4cef7-5162-4ac1-a7b5-2717bba5829d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:15.429136 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-30a4cef7-5162-4ac1-a7b5-2717bba5829d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:15.434885 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c9d353df-370f-405a-a5a4-c3fbc0bc095a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:15.435514 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-c9d353df-370f-405a-a5a4-c3fbc0bc095a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: 6e820068-00d0-4979-a583-40389d6f3732] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:15.437155 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-30a4cef7-5162-4ac1-a7b5-2717bba5829d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:15.437815 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-30a4cef7-5162-4ac1-a7b5-2717bba5829d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:15.438775 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-30a4cef7-5162-4ac1-a7b5-2717bba5829d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:15.439554 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-30a4cef7-5162-4ac1-a7b5-2717bba5829d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:15.446723 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c9d353df-370f-405a-a5a4-c3fbc0bc095a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:15.447182 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c9d353df-370f-405a-a5a4-c3fbc0bc095a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:15.448032 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c9d353df-370f-405a-a5a4-c3fbc0bc095a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:15.448480 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c9d353df-370f-405a-a5a4-c3fbc0bc095a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:15.475305 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-c9d353df-370f-405a-a5a4-c3fbc0bc095a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] HTTP exception thrown: Instance 6e820068-00d0-4979-a583-40389d6f3732 could not be found. Aug 24 19:33:15.476176 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c9d353df-370f-405a-a5a4-c3fbc0bc095a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Returning 404 to user: Instance 6e820068-00d0-4979-a583-40389d6f3732 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:33:15.477201 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c9d353df-370f-405a-a5a4-c3fbc0bc095a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732" status: 404 len: 111 microversion: 2.1 time: 0.056310 Aug 24 19:33:15.481240 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 291/581] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:15 2021] GET /compute/v2.1/servers/6e820068-00d0-4979-a583-40389d6f3732 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:33:15.486956 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-da469269-05ba-4420-a5b1-d87747e0cdfb tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:15.487746 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-da469269-05ba-4420-a5b1-d87747e0cdfb tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:15.494843 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-da469269-05ba-4420-a5b1-d87747e0cdfb tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:15.495518 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-da469269-05ba-4420-a5b1-d87747e0cdfb tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:15.496567 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-da469269-05ba-4420-a5b1-d87747e0cdfb tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:15.497160 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-da469269-05ba-4420-a5b1-d87747e0cdfb tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:15.508482 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-30a4cef7-5162-4ac1-a7b5-2717bba5829d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Going to try to terminate instance {{(pid=108907) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:33:16.882742 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-da469269-05ba-4420-a5b1-d87747e0cdfb tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "POST /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/action" status: 202 len: 0 microversion: 2.1 time: 1.399694 Aug 24 19:33:16.883868 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 292/582] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:33:15 2021] POST /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/action => generated 0 bytes in 1402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:33:16.895349 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1822741201", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "networks": [{"uuid": "7ced5917-82bb-4891-9019-04676b591e11"}]}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:17.041956 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-30a4cef7-5162-4ac1-a7b5-2717bba5829d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 204 len: 0 microversion: 2.1 time: 1.617023 Aug 24 19:33:17.046581 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 291/583] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:33:15 2021] DELETE /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 0 bytes in 1619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:33:17.055246 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-059d1411-b998-4889-9eb7-4eee35934a6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:17.056303 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-059d1411-b998-4889-9eb7-4eee35934a6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:17.062799 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-059d1411-b998-4889-9eb7-4eee35934a6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:17.063541 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-059d1411-b998-4889-9eb7-4eee35934a6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:17.065206 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-059d1411-b998-4889-9eb7-4eee35934a6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:17.065822 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-059d1411-b998-4889-9eb7-4eee35934a6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:17.316532 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-059d1411-b998-4889-9eb7-4eee35934a6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:17.326664 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-059d1411-b998-4889-9eb7-4eee35934a6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:17.328311 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-059d1411-b998-4889-9eb7-4eee35934a6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:17.329356 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-059d1411-b998-4889-9eb7-4eee35934a6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.281378 Aug 24 19:33:17.339918 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 292/584] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:17 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:17.339918 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-bc46d20a-54d9-4225-a4e6-44586b052c49 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:17.339918 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-bc46d20a-54d9-4225-a4e6-44586b052c49 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:17.341746 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bc46d20a-54d9-4225-a4e6-44586b052c49 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:17.342542 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bc46d20a-54d9-4225-a4e6-44586b052c49 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:17.343204 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bc46d20a-54d9-4225-a4e6-44586b052c49 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:17.343385 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bc46d20a-54d9-4225-a4e6-44586b052c49 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:17.574096 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-bc46d20a-54d9-4225-a4e6-44586b052c49 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:17.587372 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-bc46d20a-54d9-4225-a4e6-44586b052c49 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1554 microversion: 2.1 time: 0.256376 Aug 24 19:33:17.598792 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 293/585] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:17 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1554 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:17.598792 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-06db5f81-099d-43db-8ce5-6a0593227883 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:17.615429 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-06db5f81-099d-43db-8ce5-6a0593227883 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:17.629750 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-06db5f81-099d-43db-8ce5-6a0593227883 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:17.630193 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-06db5f81-099d-43db-8ce5-6a0593227883 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:17.630973 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-06db5f81-099d-43db-8ce5-6a0593227883 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:17.631401 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-06db5f81-099d-43db-8ce5-6a0593227883 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:17.895531 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-06db5f81-099d-43db-8ce5-6a0593227883 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:17.908765 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-06db5f81-099d-43db-8ce5-6a0593227883 tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1513 microversion: 2.1 time: 0.319637 Aug 24 19:33:17.909380 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 294/586] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:17 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1513 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:18.346941 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ae8a5f7e-c8fb-4c86-afea-0ae112879cc3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:18.347874 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ae8a5f7e-c8fb-4c86-afea-0ae112879cc3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:18.355817 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ae8a5f7e-c8fb-4c86-afea-0ae112879cc3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:18.356378 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ae8a5f7e-c8fb-4c86-afea-0ae112879cc3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:18.357111 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ae8a5f7e-c8fb-4c86-afea-0ae112879cc3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:18.357804 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ae8a5f7e-c8fb-4c86-afea-0ae112879cc3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:18.500540 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ae8a5f7e-c8fb-4c86-afea-0ae112879cc3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:18.513327 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ae8a5f7e-c8fb-4c86-afea-0ae112879cc3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:18.515367 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ae8a5f7e-c8fb-4c86-afea-0ae112879cc3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:18.516783 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ae8a5f7e-c8fb-4c86-afea-0ae112879cc3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.173532 Aug 24 19:33:18.517845 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 295/587] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:18 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:33:18.606040 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-153c1847-c467-473a-b817-724140ee232a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:18.606680 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-153c1847-c467-473a-b817-724140ee232a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:18.617786 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-153c1847-c467-473a-b817-724140ee232a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:18.618373 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-153c1847-c467-473a-b817-724140ee232a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:18.619163 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-153c1847-c467-473a-b817-724140ee232a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:18.619598 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-153c1847-c467-473a-b817-724140ee232a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:18.795022 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-153c1847-c467-473a-b817-724140ee232a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:18.806885 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-153c1847-c467-473a-b817-724140ee232a tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1554 microversion: 2.1 time: 0.203495 Aug 24 19:33:18.808805 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 296/588] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:18 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1554 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:18.901300 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5ad37b46-c52b-4063-9ca0-584a010c0b92 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Action: 'create', calling method: .version_select at 0x7f8df75cd700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-634833183"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:18.962901 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.network.neutron [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] validate_networks() for [('7ced5917-82bb-4891-9019-04676b591e11', None, None, None, None, None)] {{(pid=108908) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:33:18.967370 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-5ad37b46-c52b-4063-9ca0-584a010c0b92 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Getting quotas for project 6c0be9c2c7eb4e229138150d1a78323a. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:33:18.993124 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-5ad37b46-c52b-4063-9ca0-584a010c0b92 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Getting quotas for user 9e9f850bfa8b4266a501e3cff9ae867e and project 6c0be9c2c7eb4e229138150d1a78323a. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:33:19.014096 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5ad37b46-c52b-4063-9ca0-584a010c0b92 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [1cffa85c-030c-46e8-8bf9-e35d4db20d96] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 19:33:19.785519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Flavor limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:33:19.785519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Image limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:33:19.785519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Flavor pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:33:19.785519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Image pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:33:19.785519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:33:19.786048 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:19.786048 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:19.786048 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:19.786048 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:19.804001 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Getting quotas for project 5ed4565c07554a2e8dd34da9c4f80956. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:33:19.811225 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Getting quotas for user 77c66020d31a4598995dcabb76ce4362 and project 5ed4565c07554a2e8dd34da9c4f80956. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:33:19.824841 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Going to run 1 instances... {{(pid=108908) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:33:19.827418 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:33:20.032143 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO oslo.messaging._drivers.impl_rabbit [None req-5ad37b46-c52b-4063-9ca0-584a010c0b92 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [1cffa85c-030c-46e8-8bf9-e35d4db20d96] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 58978. Aug 24 19:33:20.456867 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-5ad37b46-c52b-4063-9ca0-584a010c0b92 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Getting quotas for project 6c0be9c2c7eb4e229138150d1a78323a. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:33:20.464665 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-5ad37b46-c52b-4063-9ca0-584a010c0b92 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Getting quotas for user 9e9f850bfa8b4266a501e3cff9ae867e and project 6c0be9c2c7eb4e229138150d1a78323a. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:33:20.478463 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5ad37b46-c52b-4063-9ca0-584a010c0b92 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 1.586162 Aug 24 19:33:20.479060 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 297/589] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Aug 24 19:33:18 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:20.483626 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5c316144-2f8f-4123-9c7f-5f1d0eefcd3d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:20.484585 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5c316144-2f8f-4123-9c7f-5f1d0eefcd3d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:20.496908 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5c316144-2f8f-4123-9c7f-5f1d0eefcd3d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:20.497653 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5c316144-2f8f-4123-9c7f-5f1d0eefcd3d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:20.498681 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5c316144-2f8f-4123-9c7f-5f1d0eefcd3d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:20.499290 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5c316144-2f8f-4123-9c7f-5f1d0eefcd3d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:20.506815 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9c17dc8b-10a4-472d-b1db-5a75a3645a6b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.621562 Aug 24 19:33:20.520672 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 293/590] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:33:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 3636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:33:20.535590 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2a1d5ba1-51da-45c0-b079-fcd3c3ad4f80 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:20.539611 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2a1d5ba1-51da-45c0-b079-fcd3c3ad4f80 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:20.547326 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2a1d5ba1-51da-45c0-b079-fcd3c3ad4f80 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:20.547778 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2a1d5ba1-51da-45c0-b079-fcd3c3ad4f80 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:20.549117 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2a1d5ba1-51da-45c0-b079-fcd3c3ad4f80 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:20.551888 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2a1d5ba1-51da-45c0-b079-fcd3c3ad4f80 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:20.599051 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5c316144-2f8f-4123-9c7f-5f1d0eefcd3d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c437fd9d3774ba58eb9b4726b7667b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a54174229cb4b11bc07726eece4a2af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:20.610757 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5c316144-2f8f-4123-9c7f-5f1d0eefcd3d tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 200 len: 1471 microversion: 2.1 time: 0.130425 Aug 24 19:33:20.614627 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 298/591] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:20 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 1471 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:20.636413 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-dd8efba9-fc7b-44ab-ba76-4b0b33576a64 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:20.637617 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-dd8efba9-fc7b-44ab-ba76-4b0b33576a64 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:20.646315 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-dd8efba9-fc7b-44ab-ba76-4b0b33576a64 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:20.647036 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-dd8efba9-fc7b-44ab-ba76-4b0b33576a64 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:20.648012 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-dd8efba9-fc7b-44ab-ba76-4b0b33576a64 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:20.648624 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-dd8efba9-fc7b-44ab-ba76-4b0b33576a64 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:20.850631 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-2a1d5ba1-51da-45c0-b079-fcd3c3ad4f80 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:20.861074 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-2a1d5ba1-51da-45c0-b079-fcd3c3ad4f80 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:20.863096 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-2a1d5ba1-51da-45c0-b079-fcd3c3ad4f80 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:20.865006 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2a1d5ba1-51da-45c0-b079-fcd3c3ad4f80 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.342928 Aug 24 19:33:20.868025 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 294/592] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:20 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:20.887255 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-dd8efba9-fc7b-44ab-ba76-4b0b33576a64 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:20.894306 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-0a585635-8a01-4bb9-8961-ea2ad67fa4ae req-109f446c-2587-4056-aaef-f751f39adbcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd316c0d-59a0-4082-91a9-019af34e063b", "name": "network-vif-deleted", "tag": "11aa4d8d-d272-4d56-a152-182570ea9cc9"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:20.896221 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:20.896221 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:33:20.897246 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-dd8efba9-fc7b-44ab-ba76-4b0b33576a64 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1560 microversion: 2.1 time: 0.281432 Aug 24 19:33:20.897892 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 299/593] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:20 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1560 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:20.902320 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-68b899d8-943a-411a-9a88-c08709da462e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:20.903282 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-68b899d8-943a-411a-9a88-c08709da462e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:20.915321 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-0a585635-8a01-4bb9-8961-ea2ad67fa4ae req-109f446c-2587-4056-aaef-f751f39adbcb service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:20.915860 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-0a585635-8a01-4bb9-8961-ea2ad67fa4ae req-109f446c-2587-4056-aaef-f751f39adbcb service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:20.934577 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-0a585635-8a01-4bb9-8961-ea2ad67fa4ae req-109f446c-2587-4056-aaef-f751f39adbcb service nova] Creating event network-vif-deleted:11aa4d8d-d272-4d56-a152-182570ea9cc9 for instance fd316c0d-59a0-4082-91a9-019af34e063b on hv-cinder-79819 Aug 24 19:33:20.939157 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-0a585635-8a01-4bb9-8961-ea2ad67fa4ae req-109f446c-2587-4056-aaef-f751f39adbcb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063209 Aug 24 19:33:20.940292 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 295/594] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:33:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:33:20.946094 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1334194544", "imageRef": "972f0c7e-9ea0-49aa-8485-b6669d7405f3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-634833183", "networks": [{"uuid": "a1a40689-de20-4662-a2d2-e22ba5cfe8ce"}]}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:21.004574 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-68b899d8-943a-411a-9a88-c08709da462e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:21.010233 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.network.neutron [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] validate_networks() for [('a1a40689-de20-4662-a2d2-e22ba5cfe8ce', None, None, None, None, None)] {{(pid=108908) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:33:21.012287 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-68b899d8-943a-411a-9a88-c08709da462e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1214 microversion: 2.1 time: 0.113137 Aug 24 19:33:21.013025 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 300/595] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:20 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:21.041662 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d8d0c518-9256-4f14-8c4f-6eb0560209c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:21.042895 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d8d0c518-9256-4f14-8c4f-6eb0560209c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:21.049575 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d8d0c518-9256-4f14-8c4f-6eb0560209c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:21.050021 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d8d0c518-9256-4f14-8c4f-6eb0560209c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:21.050800 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d8d0c518-9256-4f14-8c4f-6eb0560209c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:21.051242 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d8d0c518-9256-4f14-8c4f-6eb0560209c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:21.154374 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-d8d0c518-9256-4f14-8c4f-6eb0560209c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lazy-loading 'services' on Instance uuid 649b4ff1-abbd-4ccb-8b5a-9ba24f560372 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:33:21.529951 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Flavor limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:33:21.530464 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Image limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:33:21.530996 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Flavor pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:33:21.531467 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Image pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:33:21.531942 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:33:21.536414 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d8d0c518-9256-4f14-8c4f-6eb0560209c7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "DELETE /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/os-volume_attachments/aed80476-d091-4a6a-a51e-3a5b31aa7db2" status: 202 len: 0 microversion: 2.1 time: 0.497579 Aug 24 19:33:21.543585 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 301/596] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 24 19:33:21 2021] DELETE /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/os-volume_attachments/aed80476-d091-4a6a-a51e-3a5b31aa7db2 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:33:21.552202 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9935f7b8-5fa0-4ae9-a018-5e7057adcea2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:21.554806 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:21.555904 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9935f7b8-5fa0-4ae9-a018-5e7057adcea2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:21.556458 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:21.559813 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:21.560531 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:21.564653 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9935f7b8-5fa0-4ae9-a018-5e7057adcea2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:21.565163 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9935f7b8-5fa0-4ae9-a018-5e7057adcea2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:21.566004 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9935f7b8-5fa0-4ae9-a018-5e7057adcea2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:21.566494 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9935f7b8-5fa0-4ae9-a018-5e7057adcea2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:21.583347 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Getting quotas for project 6c0be9c2c7eb4e229138150d1a78323a. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:33:21.590750 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Getting quotas for user 9e9f850bfa8b4266a501e3cff9ae867e and project 6c0be9c2c7eb4e229138150d1a78323a. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:33:21.600355 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9935f7b8-5fa0-4ae9-a018-5e7057adcea2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055309 Aug 24 19:33:21.601152 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 302/597] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:33:21 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:33:21.603746 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Going to run 1 instances... {{(pid=108908) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:33:21.606545 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='972f0c7e-9ea0-49aa-8485-b6669d7405f3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:33:21.631690 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7a618275-b9e7-4db6-ab90-a28ce1d82eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:21.632691 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7a618275-b9e7-4db6-ab90-a28ce1d82eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] [instance: fd316c0d-59a0-4082-91a9-019af34e063b] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:21.639778 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a618275-b9e7-4db6-ab90-a28ce1d82eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:21.640202 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a618275-b9e7-4db6-ab90-a28ce1d82eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:21.641192 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a618275-b9e7-4db6-ab90-a28ce1d82eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:21.641834 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a618275-b9e7-4db6-ab90-a28ce1d82eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:21.656983 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-7a618275-b9e7-4db6-ab90-a28ce1d82eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] HTTP exception thrown: Instance fd316c0d-59a0-4082-91a9-019af34e063b could not be found. Aug 24 19:33:21.658413 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7a618275-b9e7-4db6-ab90-a28ce1d82eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] Returning 404 to user: Instance fd316c0d-59a0-4082-91a9-019af34e063b could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:33:21.659449 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7a618275-b9e7-4db6-ab90-a28ce1d82eca tempest-AttachVolumeNegativeTest-1466990869 tempest-AttachVolumeNegativeTest-1466990869-project] 10.222.0.59 "GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b" status: 404 len: 111 microversion: 2.1 time: 0.031791 Aug 24 19:33:21.660000 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 303/598] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:21 2021] GET /compute/v2.1/servers/fd316c0d-59a0-4082-91a9-019af34e063b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:33:21.763882 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2cfc0dc0-2282-45cb-a39b-e65c644c69c4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.822232 Aug 24 19:33:21.764972 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 296/599] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:33:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:33:21.774671 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a304546e-dc1b-4049-b5f7-6521a8074626 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:21.775570 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a304546e-dc1b-4049-b5f7-6521a8074626 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:21.849956 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a304546e-dc1b-4049-b5f7-6521a8074626 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:21.857031 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a304546e-dc1b-4049-b5f7-6521a8074626 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1258 microversion: 2.1 time: 0.086000 Aug 24 19:33:21.857900 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 304/600] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:21 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1258 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:21.883164 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6cb2ebcc-ca46-472e-b2e4-5492d5ed3b75 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:21.884001 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6cb2ebcc-ca46-472e-b2e4-5492d5ed3b75 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:21.894171 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6cb2ebcc-ca46-472e-b2e4-5492d5ed3b75 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:21.895128 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6cb2ebcc-ca46-472e-b2e4-5492d5ed3b75 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:21.896072 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6cb2ebcc-ca46-472e-b2e4-5492d5ed3b75 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:21.896536 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6cb2ebcc-ca46-472e-b2e4-5492d5ed3b75 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:22.030149 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-354f9de5-63cc-441d-b485-786621892c24 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:22.030934 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-354f9de5-63cc-441d-b485-786621892c24 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:22.038261 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-354f9de5-63cc-441d-b485-786621892c24 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:22.040767 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-354f9de5-63cc-441d-b485-786621892c24 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:22.040767 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-354f9de5-63cc-441d-b485-786621892c24 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:22.040767 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-354f9de5-63cc-441d-b485-786621892c24 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:22.124925 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-354f9de5-63cc-441d-b485-786621892c24 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:22.133517 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-354f9de5-63cc-441d-b485-786621892c24 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1218 microversion: 2.1 time: 0.106793 Aug 24 19:33:22.135146 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6cb2ebcc-ca46-472e-b2e4-5492d5ed3b75 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:22.136644 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 305/601] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:22 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:22.146155 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6cb2ebcc-ca46-472e-b2e4-5492d5ed3b75 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:22.154016 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6cb2ebcc-ca46-472e-b2e4-5492d5ed3b75 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:22.154016 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6cb2ebcc-ca46-472e-b2e4-5492d5ed3b75 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.270113 Aug 24 19:33:22.154016 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 297/602] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:21 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:22.613280 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c9341c83-52a4-4f34-a5ff-ed710f10a042 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:22.614200 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c9341c83-52a4-4f34-a5ff-ed710f10a042 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:22.623208 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c9341c83-52a4-4f34-a5ff-ed710f10a042 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:22.624018 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c9341c83-52a4-4f34-a5ff-ed710f10a042 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:22.625172 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c9341c83-52a4-4f34-a5ff-ed710f10a042 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:22.625827 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c9341c83-52a4-4f34-a5ff-ed710f10a042 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:22.660942 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c9341c83-52a4-4f34-a5ff-ed710f10a042 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052287 Aug 24 19:33:22.665521 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 306/603] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:33:22 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:33:22.875689 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-16301ede-064e-4702-86aa-8acd26e10d8e tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:22.877192 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-16301ede-064e-4702-86aa-8acd26e10d8e tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:22.993419 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-16301ede-064e-4702-86aa-8acd26e10d8e tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:23.002260 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-16301ede-064e-4702-86aa-8acd26e10d8e tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1258 microversion: 2.1 time: 0.131090 Aug 24 19:33:23.002844 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 298/604] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:22 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1258 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:23.150485 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-34b8e1ee-43fe-4c28-9ecf-c02b2dec0a21 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:23.151223 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-34b8e1ee-43fe-4c28-9ecf-c02b2dec0a21 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:23.158712 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-34b8e1ee-43fe-4c28-9ecf-c02b2dec0a21 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:23.171365 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f150dcae-6760-4b94-b61d-1529a9cd1b5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:23.172548 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f150dcae-6760-4b94-b61d-1529a9cd1b5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:23.175560 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-34b8e1ee-43fe-4c28-9ecf-c02b2dec0a21 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:23.177264 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-34b8e1ee-43fe-4c28-9ecf-c02b2dec0a21 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:23.177712 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-34b8e1ee-43fe-4c28-9ecf-c02b2dec0a21 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:23.185028 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f150dcae-6760-4b94-b61d-1529a9cd1b5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:23.190323 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f150dcae-6760-4b94-b61d-1529a9cd1b5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:23.192677 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f150dcae-6760-4b94-b61d-1529a9cd1b5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:23.194001 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f150dcae-6760-4b94-b61d-1529a9cd1b5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:23.406534 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-34b8e1ee-43fe-4c28-9ecf-c02b2dec0a21 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:23.417051 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-34b8e1ee-43fe-4c28-9ecf-c02b2dec0a21 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1274 microversion: 2.1 time: 0.269638 Aug 24 19:33:23.421190 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 307/605] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:23 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1274 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:23.528323 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f150dcae-6760-4b94-b61d-1529a9cd1b5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:23.539055 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f150dcae-6760-4b94-b61d-1529a9cd1b5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:23.540710 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f150dcae-6760-4b94-b61d-1529a9cd1b5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:23.542033 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f150dcae-6760-4b94-b61d-1529a9cd1b5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.375847 Aug 24 19:33:23.553576 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 299/606] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:23 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:23.675940 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-78cdd37b-2839-4eca-8a77-8008cc9bf060 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:23.677295 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-78cdd37b-2839-4eca-8a77-8008cc9bf060 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:23.687665 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-78cdd37b-2839-4eca-8a77-8008cc9bf060 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:23.689001 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-78cdd37b-2839-4eca-8a77-8008cc9bf060 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:23.689856 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-78cdd37b-2839-4eca-8a77-8008cc9bf060 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:23.690211 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-78cdd37b-2839-4eca-8a77-8008cc9bf060 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:23.744023 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-78cdd37b-2839-4eca-8a77-8008cc9bf060 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075080 Aug 24 19:33:23.745178 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 308/607] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:33:23 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:33:24.024817 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e0240198-d117-4f37-9d85-61527f648f35 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:24.025422 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e0240198-d117-4f37-9d85-61527f648f35 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:24.038319 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e0240198-d117-4f37-9d85-61527f648f35 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:24.038774 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e0240198-d117-4f37-9d85-61527f648f35 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:24.039569 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e0240198-d117-4f37-9d85-61527f648f35 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:24.040000 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e0240198-d117-4f37-9d85-61527f648f35 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:24.152814 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e0240198-d117-4f37-9d85-61527f648f35 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:24.180608 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e0240198-d117-4f37-9d85-61527f648f35 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1310 microversion: 2.1 time: 0.165090 Aug 24 19:33:24.182762 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 300/608] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:24 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1310 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:24.436661 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-88008eea-8c74-4824-ad69-0ffbc411850a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:24.436661 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-88008eea-8c74-4824-ad69-0ffbc411850a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:24.455933 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-88008eea-8c74-4824-ad69-0ffbc411850a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:24.456401 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-88008eea-8c74-4824-ad69-0ffbc411850a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:24.457513 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-88008eea-8c74-4824-ad69-0ffbc411850a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:24.458024 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-88008eea-8c74-4824-ad69-0ffbc411850a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:24.607325 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-183c1e64-e6d8-4f09-982d-b17bb2793688 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:24.607325 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-183c1e64-e6d8-4f09-982d-b17bb2793688 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:24.607325 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-183c1e64-e6d8-4f09-982d-b17bb2793688 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:24.607325 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-183c1e64-e6d8-4f09-982d-b17bb2793688 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:24.607876 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-183c1e64-e6d8-4f09-982d-b17bb2793688 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:24.607876 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-183c1e64-e6d8-4f09-982d-b17bb2793688 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:24.785316 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-88008eea-8c74-4824-ad69-0ffbc411850a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:24.793015 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-88008eea-8c74-4824-ad69-0ffbc411850a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.362000 Aug 24 19:33:24.793791 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 309/609] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:24 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:24.887361 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-183c1e64-e6d8-4f09-982d-b17bb2793688 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:24.896859 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-183c1e64-e6d8-4f09-982d-b17bb2793688 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:24.898596 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-183c1e64-e6d8-4f09-982d-b17bb2793688 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:24.903758 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-183c1e64-e6d8-4f09-982d-b17bb2793688 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.342517 Aug 24 19:33:24.904420 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 301/610] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:24 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:25.198061 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-62e79bd3-3ff4-485f-ade8-39f8006b5d6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:25.199068 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-62e79bd3-3ff4-485f-ade8-39f8006b5d6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:25.211441 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-62e79bd3-3ff4-485f-ade8-39f8006b5d6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:25.211441 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-62e79bd3-3ff4-485f-ade8-39f8006b5d6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:25.212292 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-62e79bd3-3ff4-485f-ade8-39f8006b5d6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:25.212872 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-62e79bd3-3ff4-485f-ade8-39f8006b5d6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:25.338456 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-62e79bd3-3ff4-485f-ade8-39f8006b5d6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:25.350964 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-62e79bd3-3ff4-485f-ade8-39f8006b5d6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1318 microversion: 2.1 time: 0.157252 Aug 24 19:33:25.351556 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 310/611] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:25 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:25.681257 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-5462c4b3-98c8-4ba0-9a4b-9eb951ab8256 req-7a294e16-28ff-4dff-b292-14a86f398feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71966c1-f9be-4c1c-b1b3-0b9b87351800", "tag": "22b31ca4-ca4d-4def-b031-033feec3b7b6"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:25.683865 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:25.683865 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:33:25.700410 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-5462c4b3-98c8-4ba0-9a4b-9eb951ab8256 req-7a294e16-28ff-4dff-b292-14a86f398feb service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:25.700410 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-5462c4b3-98c8-4ba0-9a4b-9eb951ab8256 req-7a294e16-28ff-4dff-b292-14a86f398feb service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:25.718670 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-5462c4b3-98c8-4ba0-9a4b-9eb951ab8256 req-7a294e16-28ff-4dff-b292-14a86f398feb service nova] Creating event network-changed:22b31ca4-ca4d-4def-b031-033feec3b7b6 for instance b71966c1-f9be-4c1c-b1b3-0b9b87351800 on hv-cinder-79819 Aug 24 19:33:25.724750 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-5462c4b3-98c8-4ba0-9a4b-9eb951ab8256 req-7a294e16-28ff-4dff-b292-14a86f398feb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048368 Aug 24 19:33:25.728708 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 302/612] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:33:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:33:25.813685 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ea2f3266-93fd-4a2e-b34b-0110ba0a4353 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:25.815245 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ea2f3266-93fd-4a2e-b34b-0110ba0a4353 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:25.831202 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea2f3266-93fd-4a2e-b34b-0110ba0a4353 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:25.834770 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea2f3266-93fd-4a2e-b34b-0110ba0a4353 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:25.836182 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea2f3266-93fd-4a2e-b34b-0110ba0a4353 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:25.838196 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea2f3266-93fd-4a2e-b34b-0110ba0a4353 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:25.925181 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f54b63d3-b31b-4341-9ceb-8f93ff63607f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:25.925968 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f54b63d3-b31b-4341-9ceb-8f93ff63607f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:25.932803 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f54b63d3-b31b-4341-9ceb-8f93ff63607f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:25.934204 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f54b63d3-b31b-4341-9ceb-8f93ff63607f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:25.936549 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f54b63d3-b31b-4341-9ceb-8f93ff63607f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:25.937494 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f54b63d3-b31b-4341-9ceb-8f93ff63607f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:26.194466 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ea2f3266-93fd-4a2e-b34b-0110ba0a4353 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:26.202564 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ea2f3266-93fd-4a2e-b34b-0110ba0a4353 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.393800 Aug 24 19:33:26.208497 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 311/613] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:25 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:26.368944 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d92bb64b-49a3-4de8-ae0b-b00905eed070 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:26.380846 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d92bb64b-49a3-4de8-ae0b-b00905eed070 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:26.383298 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d92bb64b-49a3-4de8-ae0b-b00905eed070 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:26.385275 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d92bb64b-49a3-4de8-ae0b-b00905eed070 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:26.386095 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d92bb64b-49a3-4de8-ae0b-b00905eed070 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:26.386979 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d92bb64b-49a3-4de8-ae0b-b00905eed070 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:26.438577 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f54b63d3-b31b-4341-9ceb-8f93ff63607f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:26.447600 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f54b63d3-b31b-4341-9ceb-8f93ff63607f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:26.449467 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f54b63d3-b31b-4341-9ceb-8f93ff63607f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:26.450904 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f54b63d3-b31b-4341-9ceb-8f93ff63607f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.530910 Aug 24 19:33:26.452020 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 303/614] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:25 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:33:26.510579 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-d92bb64b-49a3-4de8-ae0b-b00905eed070 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:26.520343 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d92bb64b-49a3-4de8-ae0b-b00905eed070 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1316 microversion: 2.1 time: 0.154852 Aug 24 19:33:26.524677 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 312/615] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:26 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:26.621610 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-376186499", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-948258038", "security_groups": [{"name": "tempest-secgroup-smoke-1665602613"}], "networks": [{"uuid": "c7f706d6-fd08-4f42-b9d1-cbbeb75491ec"}], "block_device_mapping_v2": [{"uuid": "b9f335b7-bd6c-4ad9-a549-eb683da3a40d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:26.644526 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8e768a1a-c71d-4cd9-8223-c51b63b66915 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:26.647402 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8e768a1a-c71d-4cd9-8223-c51b63b66915 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:26.661064 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8e768a1a-c71d-4cd9-8223-c51b63b66915 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:26.663134 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8e768a1a-c71d-4cd9-8223-c51b63b66915 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:26.665327 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8e768a1a-c71d-4cd9-8223-c51b63b66915 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:26.667217 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8e768a1a-c71d-4cd9-8223-c51b63b66915 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:26.735979 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8e768a1a-c71d-4cd9-8223-c51b63b66915 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Going to try to terminate instance {{(pid=108907) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:33:26.934889 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.network.neutron [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] validate_networks() for [('c7f706d6-fd08-4f42-b9d1-cbbeb75491ec', None, None, None, None, None)] {{(pid=108908) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:33:27.206531 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8e768a1a-c71d-4cd9-8223-c51b63b66915 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "DELETE /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 204 len: 0 microversion: 2.1 time: 0.562246 Aug 24 19:33:27.210236 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 313/616] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:33:26 2021] DELETE /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 0 bytes in 570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 19:33:27.224518 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-74362955-25be-4283-bd4c-d63b3fe07015 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:27.229300 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-74362955-25be-4283-bd4c-d63b3fe07015 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:27.249595 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74362955-25be-4283-bd4c-d63b3fe07015 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:27.250675 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74362955-25be-4283-bd4c-d63b3fe07015 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:27.254512 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74362955-25be-4283-bd4c-d63b3fe07015 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:27.256620 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74362955-25be-4283-bd4c-d63b3fe07015 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:27.719725 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-74362955-25be-4283-bd4c-d63b3fe07015 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:27.728189 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-74362955-25be-4283-bd4c-d63b3fe07015 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1507 microversion: 2.1 time: 0.513807 Aug 24 19:33:27.730935 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 314/617] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:27 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1507 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:27.739072 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d8328d08-9662-4417-8772-adac8ac2092b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:27.751825 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d8328d08-9662-4417-8772-adac8ac2092b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:27.775158 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d8328d08-9662-4417-8772-adac8ac2092b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:27.775610 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d8328d08-9662-4417-8772-adac8ac2092b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:27.776418 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d8328d08-9662-4417-8772-adac8ac2092b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:27.776845 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d8328d08-9662-4417-8772-adac8ac2092b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:28.241857 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-d8328d08-9662-4417-8772-adac8ac2092b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:28.251335 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d8328d08-9662-4417-8772-adac8ac2092b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.517830 Aug 24 19:33:28.256988 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 315/618] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:27 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:28.265540 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-40946a79-8174-491d-9b1e-5f4b27e69763 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:28.269090 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-40946a79-8174-491d-9b1e-5f4b27e69763 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:28.276435 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-40946a79-8174-491d-9b1e-5f4b27e69763 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:28.277491 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-40946a79-8174-491d-9b1e-5f4b27e69763 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:28.278471 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-40946a79-8174-491d-9b1e-5f4b27e69763 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:28.279058 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-40946a79-8174-491d-9b1e-5f4b27e69763 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:28.355031 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Flavor limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:33:28.355031 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Image limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:33:28.355031 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Flavor pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:33:28.355031 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Image pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:33:28.355031 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:33:28.379819 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:28.380579 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:28.382769 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:28.385000 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:28.413465 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Getting quotas for project c635296755b449db8c99cc0b86f4702f. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:33:28.421932 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Getting quotas for user 370ccbd2eb144262b58fd4dd35f391f6 and project c635296755b449db8c99cc0b86f4702f. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:33:28.527374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Going to run 1 instances... {{(pid=108908) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:33:28.534106 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b9f335b7-bd6c-4ad9-a549-eb683da3a40d',volume_size=None,volume_type=None)] {{(pid=108908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:33:28.553171 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-40946a79-8174-491d-9b1e-5f4b27e69763 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:28.565261 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-40946a79-8174-491d-9b1e-5f4b27e69763 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:28.567854 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-40946a79-8174-491d-9b1e-5f4b27e69763 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:28.569264 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-40946a79-8174-491d-9b1e-5f4b27e69763 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.307755 Aug 24 19:33:28.570682 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 316/619] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:28 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:28.583600 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-2acb0490-5315-4c86-b0c1-13aec7fa20e9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:28.585087 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-2acb0490-5315-4c86-b0c1-13aec7fa20e9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:28.599102 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2acb0490-5315-4c86-b0c1-13aec7fa20e9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:28.602119 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2acb0490-5315-4c86-b0c1-13aec7fa20e9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:28.602290 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2acb0490-5315-4c86-b0c1-13aec7fa20e9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:28.604051 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2acb0490-5315-4c86-b0c1-13aec7fa20e9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:28.835321 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2acb0490-5315-4c86-b0c1-13aec7fa20e9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:28.843160 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-2acb0490-5315-4c86-b0c1-13aec7fa20e9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.271241 Aug 24 19:33:28.847758 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 317/620] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:28 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:28.864957 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-a2a3c9fa-0ede-4be1-a29e-9971bd56c2ff req-df8512c0-710c-44c9-82fc-48e7ed645af8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2057e6ea-d98d-4233-b304-42ed12ce391c", "tag": "0ce85f00-01ff-4d38-89a7-beb1609b7e9a"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:28.865242 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:28.865242 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:33:28.880930 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-a2a3c9fa-0ede-4be1-a29e-9971bd56c2ff req-df8512c0-710c-44c9-82fc-48e7ed645af8 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:28.881385 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-a2a3c9fa-0ede-4be1-a29e-9971bd56c2ff req-df8512c0-710c-44c9-82fc-48e7ed645af8 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:28.903123 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-a2a3c9fa-0ede-4be1-a29e-9971bd56c2ff req-df8512c0-710c-44c9-82fc-48e7ed645af8 service nova] Creating event network-changed:0ce85f00-01ff-4d38-89a7-beb1609b7e9a for instance 2057e6ea-d98d-4233-b304-42ed12ce391c on hv-cinder-79819 Aug 24 19:33:28.909554 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-a2a3c9fa-0ede-4be1-a29e-9971bd56c2ff req-df8512c0-710c-44c9-82fc-48e7ed645af8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061812 Aug 24 19:33:28.910923 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 318/621] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:33:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:33:28.917547 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7fbb56e3-46b3-416b-823d-9e1a5c07b691 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:28.918492 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7fbb56e3-46b3-416b-823d-9e1a5c07b691 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:28.925024 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7fbb56e3-46b3-416b-823d-9e1a5c07b691 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:28.925894 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7fbb56e3-46b3-416b-823d-9e1a5c07b691 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:28.926895 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7fbb56e3-46b3-416b-823d-9e1a5c07b691 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:28.927513 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7fbb56e3-46b3-416b-823d-9e1a5c07b691 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:29.064219 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7fbb56e3-46b3-416b-823d-9e1a5c07b691 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:29.071971 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-074c5c1d-1fb8-405e-b92d-215a2b6f1fb9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.455549 Aug 24 19:33:29.078884 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 304/622] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:33:26 2021] POST /compute/v2.1/servers => generated 406 bytes in 2462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:33:29.079809 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7fbb56e3-46b3-416b-823d-9e1a5c07b691 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1507 microversion: 2.1 time: 0.167415 Aug 24 19:33:29.081331 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 319/623] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:28 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:29.093313 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-87d58e6c-fa1a-4158-939a-70638aa2533e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:29.096013 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-87d58e6c-fa1a-4158-939a-70638aa2533e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:29.159076 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-87d58e6c-fa1a-4158-939a-70638aa2533e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:29.166951 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-87d58e6c-fa1a-4158-939a-70638aa2533e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1087 microversion: 2.1 time: 0.087336 Aug 24 19:33:29.167521 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 305/624] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:29 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1087 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:29.270314 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d596d57c-74f6-43bd-b66c-2be1495d182e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:29.271229 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d596d57c-74f6-43bd-b66c-2be1495d182e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:29.281464 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d596d57c-74f6-43bd-b66c-2be1495d182e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:29.282976 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d596d57c-74f6-43bd-b66c-2be1495d182e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:29.284240 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d596d57c-74f6-43bd-b66c-2be1495d182e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:29.284734 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d596d57c-74f6-43bd-b66c-2be1495d182e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:29.463853 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-d596d57c-74f6-43bd-b66c-2be1495d182e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:29.472014 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d596d57c-74f6-43bd-b66c-2be1495d182e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.205901 Aug 24 19:33:29.472647 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 320/625] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:29 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:29.589479 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0fc10914-ac33-43c9-849d-50a5f0548945 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:29.590210 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0fc10914-ac33-43c9-849d-50a5f0548945 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:29.596992 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0fc10914-ac33-43c9-849d-50a5f0548945 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:29.597445 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0fc10914-ac33-43c9-849d-50a5f0548945 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:29.598311 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0fc10914-ac33-43c9-849d-50a5f0548945 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:29.598744 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0fc10914-ac33-43c9-849d-50a5f0548945 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:29.733313 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0fc10914-ac33-43c9-849d-50a5f0548945 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:29.744877 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0fc10914-ac33-43c9-849d-50a5f0548945 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:29.747477 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0fc10914-ac33-43c9-849d-50a5f0548945 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:29.749351 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0fc10914-ac33-43c9-849d-50a5f0548945 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.163356 Aug 24 19:33:29.750241 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 306/626] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:29 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:29.859890 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-074ffa12-e1d6-46ff-85f1-8c29431ad962 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:29.860615 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-074ffa12-e1d6-46ff-85f1-8c29431ad962 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:29.866871 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-074ffa12-e1d6-46ff-85f1-8c29431ad962 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:29.867735 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-074ffa12-e1d6-46ff-85f1-8c29431ad962 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:29.868701 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-074ffa12-e1d6-46ff-85f1-8c29431ad962 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:29.869308 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-074ffa12-e1d6-46ff-85f1-8c29431ad962 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:29.998484 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-074ffa12-e1d6-46ff-85f1-8c29431ad962 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:30.006277 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-074ffa12-e1d6-46ff-85f1-8c29431ad962 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.150032 Aug 24 19:33:30.006858 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 321/627] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:29 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:30.097887 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-628ce90d-547e-45df-986d-b32c16a0d5f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:30.098604 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-628ce90d-547e-45df-986d-b32c16a0d5f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:30.105489 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-628ce90d-547e-45df-986d-b32c16a0d5f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:30.106047 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-628ce90d-547e-45df-986d-b32c16a0d5f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:30.106841 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-628ce90d-547e-45df-986d-b32c16a0d5f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:30.107362 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-628ce90d-547e-45df-986d-b32c16a0d5f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:30.184175 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e58e0fdc-27b3-4fb1-a8dd-87c2c1dbad57 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:30.185456 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e58e0fdc-27b3-4fb1-a8dd-87c2c1dbad57 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:30.243707 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e58e0fdc-27b3-4fb1-a8dd-87c2c1dbad57 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:30.256968 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e58e0fdc-27b3-4fb1-a8dd-87c2c1dbad57 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1087 microversion: 2.1 time: 0.070736 Aug 24 19:33:30.257868 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 322/628] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:30 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:30.322843 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-628ce90d-547e-45df-986d-b32c16a0d5f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:30.332599 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-628ce90d-547e-45df-986d-b32c16a0d5f4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1507 microversion: 2.1 time: 0.238218 Aug 24 19:33:30.334184 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 307/629] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:30 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:30.499190 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6cb0666b-19af-4c06-bfe9-302189bb52a8 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:30.501112 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6cb0666b-19af-4c06-bfe9-302189bb52a8 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:30.508055 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6cb0666b-19af-4c06-bfe9-302189bb52a8 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:30.508819 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6cb0666b-19af-4c06-bfe9-302189bb52a8 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:30.509870 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6cb0666b-19af-4c06-bfe9-302189bb52a8 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:30.510356 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6cb0666b-19af-4c06-bfe9-302189bb52a8 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:30.679877 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6cb0666b-19af-4c06-bfe9-302189bb52a8 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:30.689692 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6cb0666b-19af-4c06-bfe9-302189bb52a8 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.194205 Aug 24 19:33:30.690640 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 323/630] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:30 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:30.773487 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b144da53-ef61-4fc0-a7f7-4426c1b193db tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:30.774302 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b144da53-ef61-4fc0-a7f7-4426c1b193db tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:30.781549 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b144da53-ef61-4fc0-a7f7-4426c1b193db tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:30.782237 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b144da53-ef61-4fc0-a7f7-4426c1b193db tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:30.783199 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b144da53-ef61-4fc0-a7f7-4426c1b193db tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:30.783790 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b144da53-ef61-4fc0-a7f7-4426c1b193db tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:30.942970 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b144da53-ef61-4fc0-a7f7-4426c1b193db tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:30.950980 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b144da53-ef61-4fc0-a7f7-4426c1b193db tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:30.952520 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b144da53-ef61-4fc0-a7f7-4426c1b193db tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:30.953668 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b144da53-ef61-4fc0-a7f7-4426c1b193db tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.183911 Aug 24 19:33:30.954237 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 308/631] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:30 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:31.023997 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-2a15805b-c429-4adc-a796-9595383b0750 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:31.025011 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-2a15805b-c429-4adc-a796-9595383b0750 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:31.032426 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2a15805b-c429-4adc-a796-9595383b0750 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:31.033109 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2a15805b-c429-4adc-a796-9595383b0750 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:31.034061 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2a15805b-c429-4adc-a796-9595383b0750 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:31.034786 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2a15805b-c429-4adc-a796-9595383b0750 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:31.185293 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2a15805b-c429-4adc-a796-9595383b0750 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:31.194662 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-2a15805b-c429-4adc-a796-9595383b0750 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.175238 Aug 24 19:33:31.195236 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 324/632] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:31 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:31.277926 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-715da86a-e466-40b2-b7b3-a33176887fd0 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:31.278880 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-715da86a-e466-40b2-b7b3-a33176887fd0 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:31.291569 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-715da86a-e466-40b2-b7b3-a33176887fd0 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:31.292013 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-715da86a-e466-40b2-b7b3-a33176887fd0 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:31.292818 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-715da86a-e466-40b2-b7b3-a33176887fd0 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:31.293247 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-715da86a-e466-40b2-b7b3-a33176887fd0 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:31.350504 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-defad25b-82eb-4b4b-a867-20f2a8f0ad3c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:31.353437 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-defad25b-82eb-4b4b-a867-20f2a8f0ad3c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:31.358207 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-defad25b-82eb-4b4b-a867-20f2a8f0ad3c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:31.358649 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-defad25b-82eb-4b4b-a867-20f2a8f0ad3c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:31.359379 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-715da86a-e466-40b2-b7b3-a33176887fd0 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:31.359515 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-defad25b-82eb-4b4b-a867-20f2a8f0ad3c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:31.359828 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-defad25b-82eb-4b4b-a867-20f2a8f0ad3c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:31.367207 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-715da86a-e466-40b2-b7b3-a33176887fd0 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1137 microversion: 2.1 time: 0.093935 Aug 24 19:33:31.368077 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 309/633] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:31 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1137 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:31.487433 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-defad25b-82eb-4b4b-a867-20f2a8f0ad3c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:31.495149 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-defad25b-82eb-4b4b-a867-20f2a8f0ad3c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1507 microversion: 2.1 time: 0.148237 Aug 24 19:33:31.495781 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 325/634] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:31 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:31.709047 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4ade6746-6bea-4ade-8241-c9418a645d50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:31.709570 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4ade6746-6bea-4ade-8241-c9418a645d50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:31.715228 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4ade6746-6bea-4ade-8241-c9418a645d50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:31.715665 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4ade6746-6bea-4ade-8241-c9418a645d50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:31.716446 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4ade6746-6bea-4ade-8241-c9418a645d50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:31.716871 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4ade6746-6bea-4ade-8241-c9418a645d50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:31.872848 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4ade6746-6bea-4ade-8241-c9418a645d50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:31.883773 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4ade6746-6bea-4ade-8241-c9418a645d50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.178338 Aug 24 19:33:31.894369 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 310/635] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:31 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:31.971129 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-693af8d2-3a53-485c-af0a-2ccaca5d89f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:31.972183 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-693af8d2-3a53-485c-af0a-2ccaca5d89f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:31.978899 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-693af8d2-3a53-485c-af0a-2ccaca5d89f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:31.979738 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-693af8d2-3a53-485c-af0a-2ccaca5d89f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:31.980890 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-693af8d2-3a53-485c-af0a-2ccaca5d89f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:31.981632 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-693af8d2-3a53-485c-af0a-2ccaca5d89f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:32.118385 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-693af8d2-3a53-485c-af0a-2ccaca5d89f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:32.130525 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-693af8d2-3a53-485c-af0a-2ccaca5d89f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:32.132213 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-693af8d2-3a53-485c-af0a-2ccaca5d89f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:32.133386 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-693af8d2-3a53-485c-af0a-2ccaca5d89f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.166270 Aug 24 19:33:32.144676 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 326/636] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:31 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:32.212191 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-48361fe3-072f-4b1b-9728-45a3ab0cb559 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:32.213067 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-48361fe3-072f-4b1b-9728-45a3ab0cb559 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:32.226162 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-48361fe3-072f-4b1b-9728-45a3ab0cb559 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:32.226338 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-48361fe3-072f-4b1b-9728-45a3ab0cb559 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:32.227193 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-48361fe3-072f-4b1b-9728-45a3ab0cb559 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:32.227708 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-48361fe3-072f-4b1b-9728-45a3ab0cb559 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:32.376892 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-48361fe3-072f-4b1b-9728-45a3ab0cb559 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:32.387934 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-464d509b-0494-4081-b412-76abddc556d4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:32.390123 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-464d509b-0494-4081-b412-76abddc556d4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:32.395644 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-48361fe3-072f-4b1b-9728-45a3ab0cb559 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.181824 Aug 24 19:33:32.395861 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-464d509b-0494-4081-b412-76abddc556d4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:32.396331 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-464d509b-0494-4081-b412-76abddc556d4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:32.397575 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-464d509b-0494-4081-b412-76abddc556d4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:32.398531 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 311/637] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:32 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:32.407755 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-464d509b-0494-4081-b412-76abddc556d4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:32.495937 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-464d509b-0494-4081-b412-76abddc556d4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:32.504109 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-464d509b-0494-4081-b412-76abddc556d4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1137 microversion: 2.1 time: 0.121199 Aug 24 19:33:32.507134 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 327/638] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:32 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1137 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:32.511950 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9504b7fd-39a4-41a4-be27-aa8378b0024c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:32.516319 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9504b7fd-39a4-41a4-be27-aa8378b0024c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:32.521615 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9504b7fd-39a4-41a4-be27-aa8378b0024c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:32.522330 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9504b7fd-39a4-41a4-be27-aa8378b0024c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:32.523608 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9504b7fd-39a4-41a4-be27-aa8378b0024c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:32.524234 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9504b7fd-39a4-41a4-be27-aa8378b0024c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:32.644064 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9504b7fd-39a4-41a4-be27-aa8378b0024c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:32.651543 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9504b7fd-39a4-41a4-be27-aa8378b0024c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1507 microversion: 2.1 time: 0.143420 Aug 24 19:33:32.654613 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 312/639] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:32 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1507 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:32.901905 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-83c8f46e-9753-4ac3-b9bb-4813e10cfc06 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:32.902497 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-83c8f46e-9753-4ac3-b9bb-4813e10cfc06 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:32.908938 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-83c8f46e-9753-4ac3-b9bb-4813e10cfc06 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:32.909454 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-83c8f46e-9753-4ac3-b9bb-4813e10cfc06 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:32.910324 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-83c8f46e-9753-4ac3-b9bb-4813e10cfc06 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:32.910849 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-83c8f46e-9753-4ac3-b9bb-4813e10cfc06 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:33.033933 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-83c8f46e-9753-4ac3-b9bb-4813e10cfc06 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:33.041651 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-83c8f46e-9753-4ac3-b9bb-4813e10cfc06 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.143602 Aug 24 19:33:33.042216 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 328/640] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:32 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:33.152525 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8bcd57cb-8111-4012-9481-91397e8f1ea3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:33.169897 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8bcd57cb-8111-4012-9481-91397e8f1ea3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:33.171262 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8bcd57cb-8111-4012-9481-91397e8f1ea3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:33.171949 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8bcd57cb-8111-4012-9481-91397e8f1ea3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:33.173855 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8bcd57cb-8111-4012-9481-91397e8f1ea3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:33.174601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8bcd57cb-8111-4012-9481-91397e8f1ea3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:33.315218 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8bcd57cb-8111-4012-9481-91397e8f1ea3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:33.323066 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8bcd57cb-8111-4012-9481-91397e8f1ea3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:33.324806 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8bcd57cb-8111-4012-9481-91397e8f1ea3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:33.325945 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8bcd57cb-8111-4012-9481-91397e8f1ea3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.177427 Aug 24 19:33:33.326505 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 313/641] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:33 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:33.414053 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c2664b42-fe7d-42f5-b1af-3f737df8f56c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:33.414612 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c2664b42-fe7d-42f5-b1af-3f737df8f56c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:33.420659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c2664b42-fe7d-42f5-b1af-3f737df8f56c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:33.425801 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c2664b42-fe7d-42f5-b1af-3f737df8f56c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:33.425801 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c2664b42-fe7d-42f5-b1af-3f737df8f56c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:33.425801 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c2664b42-fe7d-42f5-b1af-3f737df8f56c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:33.522163 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0b483384-7aea-403d-8094-c395f518b01d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:33.523082 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0b483384-7aea-403d-8094-c395f518b01d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:33.529364 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0b483384-7aea-403d-8094-c395f518b01d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:33.529808 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0b483384-7aea-403d-8094-c395f518b01d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:33.530635 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0b483384-7aea-403d-8094-c395f518b01d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:33.531108 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0b483384-7aea-403d-8094-c395f518b01d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:33.561559 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c2664b42-fe7d-42f5-b1af-3f737df8f56c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:33.571440 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c2664b42-fe7d-42f5-b1af-3f737df8f56c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.161468 Aug 24 19:33:33.574321 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 329/642] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:33 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:33.615167 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0b483384-7aea-403d-8094-c395f518b01d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:33.623212 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0b483384-7aea-403d-8094-c395f518b01d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1137 microversion: 2.1 time: 0.106260 Aug 24 19:33:33.623796 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 314/643] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:33 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1137 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:33.669414 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-75e59060-4615-43c5-a6ba-f0b6b3ff17b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:33.669952 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-75e59060-4615-43c5-a6ba-f0b6b3ff17b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:33.682041 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-75e59060-4615-43c5-a6ba-f0b6b3ff17b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:33.682041 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-75e59060-4615-43c5-a6ba-f0b6b3ff17b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:33.682041 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-75e59060-4615-43c5-a6ba-f0b6b3ff17b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:33.682041 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-75e59060-4615-43c5-a6ba-f0b6b3ff17b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:33.805125 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-75e59060-4615-43c5-a6ba-f0b6b3ff17b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:33.813585 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-75e59060-4615-43c5-a6ba-f0b6b3ff17b1 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1507 microversion: 2.1 time: 0.148189 Aug 24 19:33:33.836320 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 330/644] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:33 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:34.060425 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-31536632-25e7-4546-895a-d885c6787a72 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:34.061536 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-31536632-25e7-4546-895a-d885c6787a72 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:34.070040 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-31536632-25e7-4546-895a-d885c6787a72 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:34.070821 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-31536632-25e7-4546-895a-d885c6787a72 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:34.071794 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-31536632-25e7-4546-895a-d885c6787a72 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:34.072708 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-31536632-25e7-4546-895a-d885c6787a72 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:34.223777 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-31536632-25e7-4546-895a-d885c6787a72 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:34.230950 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-31536632-25e7-4546-895a-d885c6787a72 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.176353 Aug 24 19:33:34.231527 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 315/645] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:34 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:34.344725 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1c010389-47ea-46c5-848d-a3f0cf0bd598 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:34.345392 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1c010389-47ea-46c5-848d-a3f0cf0bd598 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:34.351283 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1c010389-47ea-46c5-848d-a3f0cf0bd598 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:34.351677 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1c010389-47ea-46c5-848d-a3f0cf0bd598 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:34.352501 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1c010389-47ea-46c5-848d-a3f0cf0bd598 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:34.352922 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1c010389-47ea-46c5-848d-a3f0cf0bd598 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:34.549158 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1c010389-47ea-46c5-848d-a3f0cf0bd598 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:34.559412 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1c010389-47ea-46c5-848d-a3f0cf0bd598 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:34.561018 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1c010389-47ea-46c5-848d-a3f0cf0bd598 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:34.562726 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1c010389-47ea-46c5-848d-a3f0cf0bd598 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.222414 Aug 24 19:33:34.573028 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 331/646] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:34 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:34.591059 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-40eea441-9929-4b7a-b2e2-0f610afc25a4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:34.592131 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-40eea441-9929-4b7a-b2e2-0f610afc25a4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:34.599023 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-40eea441-9929-4b7a-b2e2-0f610afc25a4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:34.599610 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-40eea441-9929-4b7a-b2e2-0f610afc25a4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:34.600523 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-40eea441-9929-4b7a-b2e2-0f610afc25a4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:34.601168 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-40eea441-9929-4b7a-b2e2-0f610afc25a4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:34.640727 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fcfacdae-0d1e-4e8c-946f-fb073bae21cb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:34.644401 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fcfacdae-0d1e-4e8c-946f-fb073bae21cb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:34.648745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fcfacdae-0d1e-4e8c-946f-fb073bae21cb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:34.649254 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fcfacdae-0d1e-4e8c-946f-fb073bae21cb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:34.650091 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fcfacdae-0d1e-4e8c-946f-fb073bae21cb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:34.650588 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fcfacdae-0d1e-4e8c-946f-fb073bae21cb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:34.769936 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fcfacdae-0d1e-4e8c-946f-fb073bae21cb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:34.775231 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-fcfacdae-0d1e-4e8c-946f-fb073bae21cb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1137 microversion: 2.1 time: 0.138321 Aug 24 19:33:34.785829 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 332/647] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:34 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1137 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:34.802656 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-40eea441-9929-4b7a-b2e2-0f610afc25a4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:34.808035 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-40eea441-9929-4b7a-b2e2-0f610afc25a4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.220840 Aug 24 19:33:34.809200 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 316/648] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:34 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:34.842730 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-36ed1798-5bd0-43ac-9372-bfaa795d58c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:34.843609 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-36ed1798-5bd0-43ac-9372-bfaa795d58c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:34.849834 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-36ed1798-5bd0-43ac-9372-bfaa795d58c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:34.850496 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-36ed1798-5bd0-43ac-9372-bfaa795d58c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:34.851265 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-36ed1798-5bd0-43ac-9372-bfaa795d58c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:34.851685 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-36ed1798-5bd0-43ac-9372-bfaa795d58c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:35.029201 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-36ed1798-5bd0-43ac-9372-bfaa795d58c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:35.037400 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-36ed1798-5bd0-43ac-9372-bfaa795d58c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1507 microversion: 2.1 time: 0.198148 Aug 24 19:33:35.037996 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 333/649] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:34 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1507 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:35.247946 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3ce185f6-900b-40be-a12d-00e9a10dafff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:35.248582 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3ce185f6-900b-40be-a12d-00e9a10dafff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:35.254595 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3ce185f6-900b-40be-a12d-00e9a10dafff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:35.255121 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3ce185f6-900b-40be-a12d-00e9a10dafff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:35.255901 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3ce185f6-900b-40be-a12d-00e9a10dafff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:35.256441 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3ce185f6-900b-40be-a12d-00e9a10dafff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:35.374203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3ce185f6-900b-40be-a12d-00e9a10dafff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:35.381393 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3ce185f6-900b-40be-a12d-00e9a10dafff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.137140 Aug 24 19:33:35.381966 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 317/650] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:35 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:35.590653 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-87c854f2-4d37-485c-bb64-c00d9022581c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:35.591245 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-87c854f2-4d37-485c-bb64-c00d9022581c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:35.597829 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-87c854f2-4d37-485c-bb64-c00d9022581c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:35.598271 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-87c854f2-4d37-485c-bb64-c00d9022581c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:35.599018 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-87c854f2-4d37-485c-bb64-c00d9022581c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:35.599437 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-87c854f2-4d37-485c-bb64-c00d9022581c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:35.715031 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-87c854f2-4d37-485c-bb64-c00d9022581c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:35.723365 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-87c854f2-4d37-485c-bb64-c00d9022581c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:35.725005 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-87c854f2-4d37-485c-bb64-c00d9022581c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:35.726131 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-87c854f2-4d37-485c-bb64-c00d9022581c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.139157 Aug 24 19:33:35.726687 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 334/651] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:35 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:35.793201 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-59695163-c832-4625-afa8-ade9371cf28a tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:35.793762 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-59695163-c832-4625-afa8-ade9371cf28a tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:35.800753 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-59695163-c832-4625-afa8-ade9371cf28a tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:35.801210 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-59695163-c832-4625-afa8-ade9371cf28a tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:35.802097 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-59695163-c832-4625-afa8-ade9371cf28a tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:35.802705 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-59695163-c832-4625-afa8-ade9371cf28a tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:35.825564 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-026c724b-ffe4-445c-b161-cec081aa3f6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:35.826193 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-026c724b-ffe4-445c-b161-cec081aa3f6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:35.836968 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-026c724b-ffe4-445c-b161-cec081aa3f6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:35.842067 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-026c724b-ffe4-445c-b161-cec081aa3f6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:35.843606 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-026c724b-ffe4-445c-b161-cec081aa3f6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:35.844125 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-026c724b-ffe4-445c-b161-cec081aa3f6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:35.876129 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-59695163-c832-4625-afa8-ade9371cf28a tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:35.883843 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-59695163-c832-4625-afa8-ade9371cf28a tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1137 microversion: 2.1 time: 0.094414 Aug 24 19:33:35.888433 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 318/652] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:35 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1137 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:35.981803 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-026c724b-ffe4-445c-b161-cec081aa3f6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:35.989295 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-026c724b-ffe4-445c-b161-cec081aa3f6b tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.167550 Aug 24 19:33:35.989862 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 335/653] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:35 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:36.055007 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8efb84ad-a208-439a-aa8a-b49c0310a87e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:36.055566 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8efb84ad-a208-439a-aa8a-b49c0310a87e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:36.062100 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8efb84ad-a208-439a-aa8a-b49c0310a87e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:36.062551 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8efb84ad-a208-439a-aa8a-b49c0310a87e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:36.063311 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8efb84ad-a208-439a-aa8a-b49c0310a87e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:36.063739 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8efb84ad-a208-439a-aa8a-b49c0310a87e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:36.205413 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8efb84ad-a208-439a-aa8a-b49c0310a87e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:36.214974 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8efb84ad-a208-439a-aa8a-b49c0310a87e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1507 microversion: 2.1 time: 0.163620 Aug 24 19:33:36.215832 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 319/654] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:36 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:36.398944 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-84759dab-399c-457e-8cc3-f19874e35bda tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:36.399656 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-84759dab-399c-457e-8cc3-f19874e35bda tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:36.406443 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-84759dab-399c-457e-8cc3-f19874e35bda tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:36.406967 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-84759dab-399c-457e-8cc3-f19874e35bda tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:36.407812 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-84759dab-399c-457e-8cc3-f19874e35bda tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:36.408817 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-84759dab-399c-457e-8cc3-f19874e35bda tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:36.539609 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-84759dab-399c-457e-8cc3-f19874e35bda tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:36.546748 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-84759dab-399c-457e-8cc3-f19874e35bda tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.151960 Aug 24 19:33:36.547299 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 336/655] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:36 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:36.744181 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c19876b4-c441-4525-b96f-bd39d9a48f18 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:36.745670 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-c19876b4-c441-4525-b96f-bd39d9a48f18 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:36.754973 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c19876b4-c441-4525-b96f-bd39d9a48f18 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:36.755807 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c19876b4-c441-4525-b96f-bd39d9a48f18 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:36.756916 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c19876b4-c441-4525-b96f-bd39d9a48f18 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:36.762383 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c19876b4-c441-4525-b96f-bd39d9a48f18 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:36.902362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-702ea10f-78dd-49a6-975f-c028aa8c8606 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:36.902977 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-702ea10f-78dd-49a6-975f-c028aa8c8606 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:36.906345 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-c19876b4-c441-4525-b96f-bd39d9a48f18 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:36.910732 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-702ea10f-78dd-49a6-975f-c028aa8c8606 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:36.911770 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-702ea10f-78dd-49a6-975f-c028aa8c8606 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:36.912863 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-702ea10f-78dd-49a6-975f-c028aa8c8606 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:36.913460 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-702ea10f-78dd-49a6-975f-c028aa8c8606 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:36.919590 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-c19876b4-c441-4525-b96f-bd39d9a48f18 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:36.919590 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-c19876b4-c441-4525-b96f-bd39d9a48f18 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:36.919590 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c19876b4-c441-4525-b96f-bd39d9a48f18 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.178033 Aug 24 19:33:36.920088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 320/656] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:36 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:36.974018 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-702ea10f-78dd-49a6-975f-c028aa8c8606 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:36.981452 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-702ea10f-78dd-49a6-975f-c028aa8c8606 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1137 microversion: 2.1 time: 0.083294 Aug 24 19:33:36.981604 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 337/657] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:36 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:37.005833 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2b704c46-5e16-4948-9219-4380a20e3333 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:37.010235 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2b704c46-5e16-4948-9219-4380a20e3333 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:37.013216 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2b704c46-5e16-4948-9219-4380a20e3333 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:37.013666 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2b704c46-5e16-4948-9219-4380a20e3333 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:37.014499 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2b704c46-5e16-4948-9219-4380a20e3333 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:37.015038 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2b704c46-5e16-4948-9219-4380a20e3333 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:37.145317 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-2b704c46-5e16-4948-9219-4380a20e3333 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:37.152779 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2b704c46-5e16-4948-9219-4380a20e3333 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.150531 Aug 24 19:33:37.153668 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 321/658] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:37 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:37.236748 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c0fc42e2-3da8-4533-8607-64ecbedc87c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:37.237456 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c0fc42e2-3da8-4533-8607-64ecbedc87c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:37.246183 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c0fc42e2-3da8-4533-8607-64ecbedc87c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:37.246923 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c0fc42e2-3da8-4533-8607-64ecbedc87c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:37.247841 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c0fc42e2-3da8-4533-8607-64ecbedc87c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:37.248519 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c0fc42e2-3da8-4533-8607-64ecbedc87c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:37.389967 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c0fc42e2-3da8-4533-8607-64ecbedc87c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:37.397292 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c0fc42e2-3da8-4533-8607-64ecbedc87c6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1507 microversion: 2.1 time: 0.169349 Aug 24 19:33:37.397850 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 338/659] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:37 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:37.563700 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2c122f36-3373-4ae8-bb3d-7fbc61161f9c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:37.564327 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2c122f36-3373-4ae8-bb3d-7fbc61161f9c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:37.570911 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2c122f36-3373-4ae8-bb3d-7fbc61161f9c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:37.571353 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2c122f36-3373-4ae8-bb3d-7fbc61161f9c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:37.572173 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2c122f36-3373-4ae8-bb3d-7fbc61161f9c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:37.572705 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2c122f36-3373-4ae8-bb3d-7fbc61161f9c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:37.699201 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-2c122f36-3373-4ae8-bb3d-7fbc61161f9c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:37.706608 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2c122f36-3373-4ae8-bb3d-7fbc61161f9c tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.147497 Aug 24 19:33:37.707176 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 322/660] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:37 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:37.935754 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4277795d-9079-478d-a1f2-5d4ef3369e57 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:37.936404 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4277795d-9079-478d-a1f2-5d4ef3369e57 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:37.942201 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4277795d-9079-478d-a1f2-5d4ef3369e57 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:37.966649 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4277795d-9079-478d-a1f2-5d4ef3369e57 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:37.966649 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4277795d-9079-478d-a1f2-5d4ef3369e57 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:37.966649 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4277795d-9079-478d-a1f2-5d4ef3369e57 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:37.998146 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-81c19b28-43a5-481f-a4fe-0ebe16a33a10 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:37.999000 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-81c19b28-43a5-481f-a4fe-0ebe16a33a10 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:38.005094 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-81c19b28-43a5-481f-a4fe-0ebe16a33a10 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:38.005538 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-81c19b28-43a5-481f-a4fe-0ebe16a33a10 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:38.006315 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-81c19b28-43a5-481f-a4fe-0ebe16a33a10 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:38.006745 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-81c19b28-43a5-481f-a4fe-0ebe16a33a10 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:38.080051 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-81c19b28-43a5-481f-a4fe-0ebe16a33a10 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:38.090471 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-81c19b28-43a5-481f-a4fe-0ebe16a33a10 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1137 microversion: 2.1 time: 0.095336 Aug 24 19:33:38.090471 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 323/661] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:37 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1137 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:38.092360 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4277795d-9079-478d-a1f2-5d4ef3369e57 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:38.107923 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4277795d-9079-478d-a1f2-5d4ef3369e57 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:38.122391 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4277795d-9079-478d-a1f2-5d4ef3369e57 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:38.124385 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4277795d-9079-478d-a1f2-5d4ef3369e57 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.191736 Aug 24 19:33:38.124951 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 339/662] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:37 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:38.169171 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e20864d8-4270-46e3-b779-6bfca60ce3d3 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:38.169583 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e20864d8-4270-46e3-b779-6bfca60ce3d3 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:38.176005 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e20864d8-4270-46e3-b779-6bfca60ce3d3 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:38.176493 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e20864d8-4270-46e3-b779-6bfca60ce3d3 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:38.181903 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e20864d8-4270-46e3-b779-6bfca60ce3d3 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:38.181903 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e20864d8-4270-46e3-b779-6bfca60ce3d3 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:38.305625 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e20864d8-4270-46e3-b779-6bfca60ce3d3 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:38.313291 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e20864d8-4270-46e3-b779-6bfca60ce3d3 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.148010 Aug 24 19:33:38.313851 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 324/663] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:38 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:38.414665 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-275ac513-b489-47ee-8e1f-da907981db92 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:38.415367 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-275ac513-b489-47ee-8e1f-da907981db92 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:38.421809 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-275ac513-b489-47ee-8e1f-da907981db92 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:38.422238 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-275ac513-b489-47ee-8e1f-da907981db92 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:38.423079 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-275ac513-b489-47ee-8e1f-da907981db92 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:38.423592 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-275ac513-b489-47ee-8e1f-da907981db92 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:38.556386 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-275ac513-b489-47ee-8e1f-da907981db92 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:38.560885 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-275ac513-b489-47ee-8e1f-da907981db92 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1507 microversion: 2.1 time: 0.150178 Aug 24 19:33:38.561450 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 340/664] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:38 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:38.725340 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-554d0317-340d-46cc-9bc9-504f389d4d2a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:38.726578 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-554d0317-340d-46cc-9bc9-504f389d4d2a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:38.733706 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-554d0317-340d-46cc-9bc9-504f389d4d2a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:38.756984 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-554d0317-340d-46cc-9bc9-504f389d4d2a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:38.756984 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-554d0317-340d-46cc-9bc9-504f389d4d2a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:38.756984 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-554d0317-340d-46cc-9bc9-504f389d4d2a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:38.870708 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-554d0317-340d-46cc-9bc9-504f389d4d2a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:38.878672 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-554d0317-340d-46cc-9bc9-504f389d4d2a tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.158584 Aug 24 19:33:38.879234 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 325/665] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:38 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:39.106689 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6620f443-47a9-427f-bb2b-b56ba289ad86 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:39.107363 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6620f443-47a9-427f-bb2b-b56ba289ad86 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:39.113378 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6620f443-47a9-427f-bb2b-b56ba289ad86 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:39.113910 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6620f443-47a9-427f-bb2b-b56ba289ad86 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:39.114755 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6620f443-47a9-427f-bb2b-b56ba289ad86 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:39.115246 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6620f443-47a9-427f-bb2b-b56ba289ad86 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:39.151609 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6c07902c-5489-4725-a800-086b8f7d9417 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:39.153115 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6c07902c-5489-4725-a800-086b8f7d9417 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:39.161654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6c07902c-5489-4725-a800-086b8f7d9417 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:39.162497 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6c07902c-5489-4725-a800-086b8f7d9417 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:39.163491 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6c07902c-5489-4725-a800-086b8f7d9417 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:39.164109 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6c07902c-5489-4725-a800-086b8f7d9417 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:39.184979 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6620f443-47a9-427f-bb2b-b56ba289ad86 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:39.193823 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6620f443-47a9-427f-bb2b-b56ba289ad86 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1137 microversion: 2.1 time: 0.090703 Aug 24 19:33:39.198657 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 341/666] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:39 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1137 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:39.320180 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6c07902c-5489-4725-a800-086b8f7d9417 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:39.336964 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f0c39241-9ed6-4e85-aab3-6a5e7dee8dfe tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:39.337129 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6c07902c-5489-4725-a800-086b8f7d9417 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:39.337335 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f0c39241-9ed6-4e85-aab3-6a5e7dee8dfe tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:39.337496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6c07902c-5489-4725-a800-086b8f7d9417 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:39.337496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6c07902c-5489-4725-a800-086b8f7d9417 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.190562 Aug 24 19:33:39.337496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 326/667] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:39 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:33:39.338339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0c39241-9ed6-4e85-aab3-6a5e7dee8dfe tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:39.338339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0c39241-9ed6-4e85-aab3-6a5e7dee8dfe tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:39.340473 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0c39241-9ed6-4e85-aab3-6a5e7dee8dfe tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:39.341088 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0c39241-9ed6-4e85-aab3-6a5e7dee8dfe tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:39.476536 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f0c39241-9ed6-4e85-aab3-6a5e7dee8dfe tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:39.483707 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f0c39241-9ed6-4e85-aab3-6a5e7dee8dfe tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.157582 Aug 24 19:33:39.491752 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 342/668] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:39 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:39.578236 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0d0f93ac-45bf-48ca-8af5-c8ac5ffe2b00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:39.578755 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0d0f93ac-45bf-48ca-8af5-c8ac5ffe2b00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:39.584580 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0d0f93ac-45bf-48ca-8af5-c8ac5ffe2b00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:39.585026 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0d0f93ac-45bf-48ca-8af5-c8ac5ffe2b00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:39.585815 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0d0f93ac-45bf-48ca-8af5-c8ac5ffe2b00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:39.586242 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0d0f93ac-45bf-48ca-8af5-c8ac5ffe2b00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:39.713094 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0d0f93ac-45bf-48ca-8af5-c8ac5ffe2b00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:39.720847 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0d0f93ac-45bf-48ca-8af5-c8ac5ffe2b00 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1507 microversion: 2.1 time: 0.146882 Aug 24 19:33:39.721598 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 327/669] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:39 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:39.896338 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b3f7360a-6388-46c2-854f-b623590da23d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:39.897057 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b3f7360a-6388-46c2-854f-b623590da23d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:39.903153 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3f7360a-6388-46c2-854f-b623590da23d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:39.903777 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3f7360a-6388-46c2-854f-b623590da23d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:39.904617 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3f7360a-6388-46c2-854f-b623590da23d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:39.905135 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3f7360a-6388-46c2-854f-b623590da23d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:40.037979 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b3f7360a-6388-46c2-854f-b623590da23d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:40.047804 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b3f7360a-6388-46c2-854f-b623590da23d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.154951 Aug 24 19:33:40.049073 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 343/670] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:39 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:40.213596 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3bb32b8b-745f-4355-90b5-f93802bb59c2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:40.214233 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3bb32b8b-745f-4355-90b5-f93802bb59c2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:40.220399 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3bb32b8b-745f-4355-90b5-f93802bb59c2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:40.220892 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3bb32b8b-745f-4355-90b5-f93802bb59c2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:40.221669 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3bb32b8b-745f-4355-90b5-f93802bb59c2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:40.222108 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3bb32b8b-745f-4355-90b5-f93802bb59c2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:40.291671 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3bb32b8b-745f-4355-90b5-f93802bb59c2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:40.299603 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3bb32b8b-745f-4355-90b5-f93802bb59c2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1137 microversion: 2.1 time: 0.089711 Aug 24 19:33:40.300317 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 328/671] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:40 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:40.352909 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-68f72f1a-ce14-4042-bd0c-3f30e15a2b98 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:40.353594 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-68f72f1a-ce14-4042-bd0c-3f30e15a2b98 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:40.360038 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-68f72f1a-ce14-4042-bd0c-3f30e15a2b98 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:40.363755 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-68f72f1a-ce14-4042-bd0c-3f30e15a2b98 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:40.363755 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-68f72f1a-ce14-4042-bd0c-3f30e15a2b98 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:40.363755 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-68f72f1a-ce14-4042-bd0c-3f30e15a2b98 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:40.498649 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-68f72f1a-ce14-4042-bd0c-3f30e15a2b98 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:40.503732 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f487815e-4da6-4ace-bf5e-55a4f28a7133 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:40.504680 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f487815e-4da6-4ace-bf5e-55a4f28a7133 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:40.506745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-68f72f1a-ce14-4042-bd0c-3f30e15a2b98 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:40.508226 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-68f72f1a-ce14-4042-bd0c-3f30e15a2b98 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:40.509403 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-68f72f1a-ce14-4042-bd0c-3f30e15a2b98 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.160239 Aug 24 19:33:40.509968 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 344/672] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:40 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:40.512545 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f487815e-4da6-4ace-bf5e-55a4f28a7133 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:40.512995 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f487815e-4da6-4ace-bf5e-55a4f28a7133 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:40.513787 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f487815e-4da6-4ace-bf5e-55a4f28a7133 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:40.514214 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f487815e-4da6-4ace-bf5e-55a4f28a7133 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:40.634194 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f487815e-4da6-4ace-bf5e-55a4f28a7133 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:40.642509 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f487815e-4da6-4ace-bf5e-55a4f28a7133 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.145812 Aug 24 19:33:40.643123 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 329/673] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:40 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:40.739987 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-14cf3f7a-4bc8-4204-8b86-b6a7fc919dbc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:40.741741 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-14cf3f7a-4bc8-4204-8b86-b6a7fc919dbc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:40.749878 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-14cf3f7a-4bc8-4204-8b86-b6a7fc919dbc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:40.750585 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-14cf3f7a-4bc8-4204-8b86-b6a7fc919dbc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:40.751996 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-14cf3f7a-4bc8-4204-8b86-b6a7fc919dbc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:40.752609 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-14cf3f7a-4bc8-4204-8b86-b6a7fc919dbc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:40.891629 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-14cf3f7a-4bc8-4204-8b86-b6a7fc919dbc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:40.899359 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-14cf3f7a-4bc8-4204-8b86-b6a7fc919dbc tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1507 microversion: 2.1 time: 0.164055 Aug 24 19:33:40.899936 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 345/674] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:40 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:41.065045 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e9300e0b-8cfd-4941-8a39-9e7a16144697 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:41.065768 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e9300e0b-8cfd-4941-8a39-9e7a16144697 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:41.071659 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e9300e0b-8cfd-4941-8a39-9e7a16144697 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:41.072099 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e9300e0b-8cfd-4941-8a39-9e7a16144697 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:41.072894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e9300e0b-8cfd-4941-8a39-9e7a16144697 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:41.073441 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e9300e0b-8cfd-4941-8a39-9e7a16144697 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:41.209126 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e9300e0b-8cfd-4941-8a39-9e7a16144697 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:41.216761 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e9300e0b-8cfd-4941-8a39-9e7a16144697 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.155915 Aug 24 19:33:41.217966 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 330/675] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:41 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:41.324120 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-de453ffc-bdc8-4ba6-8c8a-d9ff14f0e987 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:41.324778 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-de453ffc-bdc8-4ba6-8c8a-d9ff14f0e987 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:41.331296 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-de453ffc-bdc8-4ba6-8c8a-d9ff14f0e987 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:41.331742 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-de453ffc-bdc8-4ba6-8c8a-d9ff14f0e987 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:41.332539 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-de453ffc-bdc8-4ba6-8c8a-d9ff14f0e987 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:41.332969 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-de453ffc-bdc8-4ba6-8c8a-d9ff14f0e987 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:41.395739 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-de453ffc-bdc8-4ba6-8c8a-d9ff14f0e987 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:41.405176 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-de453ffc-bdc8-4ba6-8c8a-d9ff14f0e987 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1129 microversion: 2.1 time: 0.084710 Aug 24 19:33:41.405856 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 346/676] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:41 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1129 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:41.527073 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e52b27e0-f16c-43da-9a7f-7f110d6805b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:41.527697 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e52b27e0-f16c-43da-9a7f-7f110d6805b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:41.533943 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e52b27e0-f16c-43da-9a7f-7f110d6805b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:41.534393 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e52b27e0-f16c-43da-9a7f-7f110d6805b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:41.535165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e52b27e0-f16c-43da-9a7f-7f110d6805b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:41.535598 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e52b27e0-f16c-43da-9a7f-7f110d6805b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:41.658903 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d74959de-b192-4cbc-b1bd-a5302fdeb7f6 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:41.659507 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d74959de-b192-4cbc-b1bd-a5302fdeb7f6 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:41.665907 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d74959de-b192-4cbc-b1bd-a5302fdeb7f6 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:41.666344 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d74959de-b192-4cbc-b1bd-a5302fdeb7f6 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:41.667103 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d74959de-b192-4cbc-b1bd-a5302fdeb7f6 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:41.667532 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d74959de-b192-4cbc-b1bd-a5302fdeb7f6 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:41.762763 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e52b27e0-f16c-43da-9a7f-7f110d6805b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:41.774309 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e52b27e0-f16c-43da-9a7f-7f110d6805b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:41.776027 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e52b27e0-f16c-43da-9a7f-7f110d6805b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:41.778230 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e52b27e0-f16c-43da-9a7f-7f110d6805b7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1738 microversion: 2.20 time: 0.254292 Aug 24 19:33:41.779319 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 331/677] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:41 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:41.831413 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-d74959de-b192-4cbc-b1bd-a5302fdeb7f6 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:41.838758 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d74959de-b192-4cbc-b1bd-a5302fdeb7f6 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.183626 Aug 24 19:33:41.839970 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 347/678] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:41 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:41.918216 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-fd4c8821-9bf0-440b-8a43-0535a1621954 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:41.918828 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-fd4c8821-9bf0-440b-8a43-0535a1621954 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:41.927492 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fd4c8821-9bf0-440b-8a43-0535a1621954 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:41.927492 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fd4c8821-9bf0-440b-8a43-0535a1621954 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:41.927492 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fd4c8821-9bf0-440b-8a43-0535a1621954 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:41.927492 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fd4c8821-9bf0-440b-8a43-0535a1621954 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:42.051527 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-fd4c8821-9bf0-440b-8a43-0535a1621954 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:42.059599 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-fd4c8821-9bf0-440b-8a43-0535a1621954 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1507 microversion: 2.1 time: 0.144954 Aug 24 19:33:42.063916 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 332/679] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:41 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1507 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:42.235479 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b8e79d0c-87a3-40c9-9ab3-8b682959f5ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:42.236287 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b8e79d0c-87a3-40c9-9ab3-8b682959f5ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:42.243508 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8e79d0c-87a3-40c9-9ab3-8b682959f5ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:42.248508 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8e79d0c-87a3-40c9-9ab3-8b682959f5ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:42.249609 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8e79d0c-87a3-40c9-9ab3-8b682959f5ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:42.250060 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8e79d0c-87a3-40c9-9ab3-8b682959f5ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:42.373033 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-10c4102b-1a55-4b28-afb7-ec0c78918ce2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:42.373863 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-10c4102b-1a55-4b28-afb7-ec0c78918ce2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:42.384412 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-10c4102b-1a55-4b28-afb7-ec0c78918ce2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:42.387638 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-10c4102b-1a55-4b28-afb7-ec0c78918ce2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:42.390692 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-10c4102b-1a55-4b28-afb7-ec0c78918ce2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:42.391805 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-10c4102b-1a55-4b28-afb7-ec0c78918ce2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:42.443894 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b8e79d0c-87a3-40c9-9ab3-8b682959f5ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:42.452556 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b8e79d0c-87a3-40c9-9ab3-8b682959f5ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.221146 Aug 24 19:33:42.454188 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 348/680] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:42 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:42.460228 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-855b7535-825f-4331-ad8b-a8d4372f0265 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:42.460934 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-855b7535-825f-4331-ad8b-a8d4372f0265 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:42.467303 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-855b7535-825f-4331-ad8b-a8d4372f0265 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:42.469299 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-855b7535-825f-4331-ad8b-a8d4372f0265 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:42.469299 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-855b7535-825f-4331-ad8b-a8d4372f0265 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:42.469299 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-855b7535-825f-4331-ad8b-a8d4372f0265 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:42.530361 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.objects.instance [None req-10c4102b-1a55-4b28-afb7-ec0c78918ce2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lazy-loading 'services' on Instance uuid a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 {{(pid=108908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:33:42.576915 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-855b7535-825f-4331-ad8b-a8d4372f0265 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:42.588895 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-855b7535-825f-4331-ad8b-a8d4372f0265 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1193 microversion: 2.1 time: 0.129606 Aug 24 19:33:42.589513 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 349/681] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:42 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1193 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:42.790742 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-10c4102b-1a55-4b28-afb7-ec0c78918ce2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/os-volume_attachments/e063645f-0b3b-414e-b3ab-91408afe8432" status: 202 len: 0 microversion: 2.1 time: 0.423472 Aug 24 19:33:42.791575 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 333/682] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 24 19:33:42 2021] DELETE /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/os-volume_attachments/e063645f-0b3b-414e-b3ab-91408afe8432 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:33:42.800599 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7397dd94-b5a4-4df0-a0ca-c4624b20f8ed tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:42.801380 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7397dd94-b5a4-4df0-a0ca-c4624b20f8ed tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:42.808013 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7397dd94-b5a4-4df0-a0ca-c4624b20f8ed tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:42.808733 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7397dd94-b5a4-4df0-a0ca-c4624b20f8ed tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:42.817221 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7397dd94-b5a4-4df0-a0ca-c4624b20f8ed tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:42.817221 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7397dd94-b5a4-4df0-a0ca-c4624b20f8ed tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:42.858735 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e13d034b-345b-4f91-802c-6956b737b786 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:42.859505 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e13d034b-345b-4f91-802c-6956b737b786 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:42.876394 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e13d034b-345b-4f91-802c-6956b737b786 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:42.882236 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e13d034b-345b-4f91-802c-6956b737b786 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:42.882236 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e13d034b-345b-4f91-802c-6956b737b786 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:42.882236 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e13d034b-345b-4f91-802c-6956b737b786 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:43.171176 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7397dd94-b5a4-4df0-a0ca-c4624b20f8ed tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:43.176593 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e13d034b-345b-4f91-802c-6956b737b786 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:43.181703 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7397dd94-b5a4-4df0-a0ca-c4624b20f8ed tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:43.183347 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7397dd94-b5a4-4df0-a0ca-c4624b20f8ed tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:43.184593 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7397dd94-b5a4-4df0-a0ca-c4624b20f8ed tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1720 microversion: 2.20 time: 0.388946 Aug 24 19:33:43.185232 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 350/683] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:42 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1720 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:43.186098 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e13d034b-345b-4f91-802c-6956b737b786 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.332011 Aug 24 19:33:43.187177 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 334/684] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:42 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:43.199841 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-066d96b0-daaf-4524-a033-d21588dc4c4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:43.200745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-066d96b0-daaf-4524-a033-d21588dc4c4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:43.207706 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-066d96b0-daaf-4524-a033-d21588dc4c4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:43.208155 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-066d96b0-daaf-4524-a033-d21588dc4c4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:43.208975 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-066d96b0-daaf-4524-a033-d21588dc4c4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:43.209404 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-066d96b0-daaf-4524-a033-d21588dc4c4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:43.357273 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-066d96b0-daaf-4524-a033-d21588dc4c4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:43.364448 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-066d96b0-daaf-4524-a033-d21588dc4c4b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1507 microversion: 2.1 time: 0.178058 Aug 24 19:33:43.365006 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 351/685] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:43 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:43.470190 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-55f3b6ba-7167-45e3-889a-85ed57a5769f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:43.476562 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-55f3b6ba-7167-45e3-889a-85ed57a5769f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:43.477251 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-55f3b6ba-7167-45e3-889a-85ed57a5769f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:43.477703 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-55f3b6ba-7167-45e3-889a-85ed57a5769f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:43.478530 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-55f3b6ba-7167-45e3-889a-85ed57a5769f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:43.478967 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-55f3b6ba-7167-45e3-889a-85ed57a5769f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:43.606328 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ca2ef1d8-c644-453e-9cb5-f1a69455beec tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:43.607643 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ca2ef1d8-c644-453e-9cb5-f1a69455beec tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:43.616149 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ca2ef1d8-c644-453e-9cb5-f1a69455beec tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:43.616848 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ca2ef1d8-c644-453e-9cb5-f1a69455beec tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:43.620238 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ca2ef1d8-c644-453e-9cb5-f1a69455beec tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:43.620701 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ca2ef1d8-c644-453e-9cb5-f1a69455beec tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:43.632430 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-55f3b6ba-7167-45e3-889a-85ed57a5769f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:43.641108 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-55f3b6ba-7167-45e3-889a-85ed57a5769f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.174739 Aug 24 19:33:43.641974 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 335/686] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:43 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:44.137195 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ca2ef1d8-c644-453e-9cb5-f1a69455beec tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:44.145001 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ca2ef1d8-c644-453e-9cb5-f1a69455beec tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1271 microversion: 2.1 time: 0.542164 Aug 24 19:33:44.150229 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 352/687] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:43 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1271 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:44.204353 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4f7675a1-42c1-4820-9b76-e171ccb1f1be tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:44.204730 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4c599a38-a162-47b3-84eb-b213e83b9290 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:44.205405 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4c599a38-a162-47b3-84eb-b213e83b9290 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:44.205583 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4f7675a1-42c1-4820-9b76-e171ccb1f1be tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:44.212639 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4c599a38-a162-47b3-84eb-b213e83b9290 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:44.213224 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4c599a38-a162-47b3-84eb-b213e83b9290 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:44.214353 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4c599a38-a162-47b3-84eb-b213e83b9290 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:44.214936 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4c599a38-a162-47b3-84eb-b213e83b9290 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:44.215427 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f7675a1-42c1-4820-9b76-e171ccb1f1be tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:44.216048 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f7675a1-42c1-4820-9b76-e171ccb1f1be tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:44.217697 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f7675a1-42c1-4820-9b76-e171ccb1f1be tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:44.218871 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4f7675a1-42c1-4820-9b76-e171ccb1f1be tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:44.487390 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4c599a38-a162-47b3-84eb-b213e83b9290 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:44.490009 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4f7675a1-42c1-4820-9b76-e171ccb1f1be tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:44.495045 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4c599a38-a162-47b3-84eb-b213e83b9290 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.294304 Aug 24 19:33:44.495626 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 353/688] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:44 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:44.508492 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4f7675a1-42c1-4820-9b76-e171ccb1f1be tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:44.508658 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-845eeb8c-17f4-4e21-bd01-17635e04d1e5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:44.508748 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4f7675a1-42c1-4820-9b76-e171ccb1f1be tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:44.508856 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-845eeb8c-17f4-4e21-bd01-17635e04d1e5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:44.508940 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4f7675a1-42c1-4820-9b76-e171ccb1f1be tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1720 microversion: 2.20 time: 0.300721 Aug 24 19:33:44.508940 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 336/689] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:44 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1720 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:44.508940 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-536e2e1d-9eee-46ac-b274-0b5566db2cd7 req-b3c8deb6-bcd6-46fd-9bd0-ceb68210bd89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3252f0-c442-46e2-9da6-666aacad067c", "name": "network-vif-deleted", "tag": "f205b3f4-2282-41d5-8ee6-7679e24a4176"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:44.509171 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-845eeb8c-17f4-4e21-bd01-17635e04d1e5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:44.509171 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-845eeb8c-17f4-4e21-bd01-17635e04d1e5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:44.509171 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-845eeb8c-17f4-4e21-bd01-17635e04d1e5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:44.509393 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:44.509393 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:33:44.509557 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-845eeb8c-17f4-4e21-bd01-17635e04d1e5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:44.515499 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-536e2e1d-9eee-46ac-b274-0b5566db2cd7 req-b3c8deb6-bcd6-46fd-9bd0-ceb68210bd89 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:44.516128 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-536e2e1d-9eee-46ac-b274-0b5566db2cd7 req-b3c8deb6-bcd6-46fd-9bd0-ceb68210bd89 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:44.528243 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-536e2e1d-9eee-46ac-b274-0b5566db2cd7 req-b3c8deb6-bcd6-46fd-9bd0-ceb68210bd89 service nova] Creating event network-vif-deleted:f205b3f4-2282-41d5-8ee6-7679e24a4176 for instance 0b3252f0-c442-46e2-9da6-666aacad067c on hv-cinder-79819 Aug 24 19:33:44.533837 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-536e2e1d-9eee-46ac-b274-0b5566db2cd7 req-b3c8deb6-bcd6-46fd-9bd0-ceb68210bd89 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031086 Aug 24 19:33:44.534515 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 337/690] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:33:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:33:44.572822 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-845eeb8c-17f4-4e21-bd01-17635e04d1e5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:44.580536 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-845eeb8c-17f4-4e21-bd01-17635e04d1e5 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1465 microversion: 2.1 time: 0.083901 Aug 24 19:33:44.581101 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 354/691] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:44 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1465 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:44.659359 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9fc4d189-131d-4db0-91c1-230e3b88a902 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:44.660441 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9fc4d189-131d-4db0-91c1-230e3b88a902 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:44.667186 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9fc4d189-131d-4db0-91c1-230e3b88a902 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:44.668637 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9fc4d189-131d-4db0-91c1-230e3b88a902 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:44.668637 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9fc4d189-131d-4db0-91c1-230e3b88a902 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:44.668905 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9fc4d189-131d-4db0-91c1-230e3b88a902 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:44.972455 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9fc4d189-131d-4db0-91c1-230e3b88a902 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:44.978838 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9fc4d189-131d-4db0-91c1-230e3b88a902 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.324095 Aug 24 19:33:44.979417 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 338/692] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:44 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:45.021762 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-00fd4e2d-181a-48b0-a4b6-4a174ef449cf req-c478427a-c754-4201-94ec-2c34b6ee8927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c70c776-ec7a-4970-9d9f-baf8c6568257", "name": "network-vif-unplugged", "status": "completed", "tag": "39906ad8-eb91-4f23-8e1c-cbdd3d7aa570"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:45.025617 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:45.025617 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:33:45.040472 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-00fd4e2d-181a-48b0-a4b6-4a174ef449cf req-c478427a-c754-4201-94ec-2c34b6ee8927 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.040472 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-00fd4e2d-181a-48b0-a4b6-4a174ef449cf req-c478427a-c754-4201-94ec-2c34b6ee8927 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.051618 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-00fd4e2d-181a-48b0-a4b6-4a174ef449cf req-c478427a-c754-4201-94ec-2c34b6ee8927 service nova] Creating event network-vif-unplugged:39906ad8-eb91-4f23-8e1c-cbdd3d7aa570 for instance 7c70c776-ec7a-4970-9d9f-baf8c6568257 on hv-cinder-79819 Aug 24 19:33:45.056286 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d2d9837e-0daf-4fdd-8534-f549d718306f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:45.058844 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-00fd4e2d-181a-48b0-a4b6-4a174ef449cf req-c478427a-c754-4201-94ec-2c34b6ee8927 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043062 Aug 24 19:33:45.060248 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 355/693] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:33:45 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:33:45.064064 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d2d9837e-0daf-4fdd-8534-f549d718306f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.064464 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d2d9837e-0daf-4fdd-8534-f549d718306f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.089401 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d2d9837e-0daf-4fdd-8534-f549d718306f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Going to try to stop instance {{(pid=108908) force_stop /opt/stack/nova/nova/compute/api.py:2614}} Aug 24 19:33:45.147166 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-137f0e64-91b2-4892-a284-75bda21ea16e req-13b7277a-a339-4e31-912c-cce772d4fe10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff70d818-92c2-45bf-b298-96a45eb576a3", "tag": "9eae3e9d-b91a-4a71-8862-9ab8e3b42579"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:45.148694 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:45.148694 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:33:45.156104 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-137f0e64-91b2-4892-a284-75bda21ea16e req-13b7277a-a339-4e31-912c-cce772d4fe10 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.156791 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-137f0e64-91b2-4892-a284-75bda21ea16e req-13b7277a-a339-4e31-912c-cce772d4fe10 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.168195 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-137f0e64-91b2-4892-a284-75bda21ea16e req-13b7277a-a339-4e31-912c-cce772d4fe10 service nova] Creating event network-changed:9eae3e9d-b91a-4a71-8862-9ab8e3b42579 for instance ff70d818-92c2-45bf-b298-96a45eb576a3 on hv-cinder-79819 Aug 24 19:33:45.173562 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-137f0e64-91b2-4892-a284-75bda21ea16e req-13b7277a-a339-4e31-912c-cce772d4fe10 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030294 Aug 24 19:33:45.174994 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 356/694] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:33:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:33:45.182913 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-267a380a-dd94-4c51-906f-4950b37eb72c tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:45.183979 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-267a380a-dd94-4c51-906f-4950b37eb72c tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:45.193051 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-267a380a-dd94-4c51-906f-4950b37eb72c tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.193920 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-267a380a-dd94-4c51-906f-4950b37eb72c tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.195036 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-267a380a-dd94-4c51-906f-4950b37eb72c tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.195743 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-267a380a-dd94-4c51-906f-4950b37eb72c tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.316684 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d2d9837e-0daf-4fdd-8534-f549d718306f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 202 len: 0 microversion: 2.1 time: 0.264937 Aug 24 19:33:45.317783 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 339/695] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:33:45 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:33:45.328799 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-71a7393c-c4a9-4e18-a6f0-5beb1c4fc756 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:45.329983 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-71a7393c-c4a9-4e18-a6f0-5beb1c4fc756 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:45.340307 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-71a7393c-c4a9-4e18-a6f0-5beb1c4fc756 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.341057 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-71a7393c-c4a9-4e18-a6f0-5beb1c4fc756 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.342271 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-71a7393c-c4a9-4e18-a6f0-5beb1c4fc756 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.342878 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-71a7393c-c4a9-4e18-a6f0-5beb1c4fc756 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.430869 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-267a380a-dd94-4c51-906f-4950b37eb72c tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:45.439163 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-267a380a-dd94-4c51-906f-4950b37eb72c tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.262181 Aug 24 19:33:45.440996 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 357/696] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:45 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:45.511801 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-31d2f601-efb0-44e0-b562-4b3ca5cc7bf0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:45.513795 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-31d2f601-efb0-44e0-b562-4b3ca5cc7bf0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:45.519899 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-31d2f601-efb0-44e0-b562-4b3ca5cc7bf0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.520484 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-31d2f601-efb0-44e0-b562-4b3ca5cc7bf0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.521435 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-31d2f601-efb0-44e0-b562-4b3ca5cc7bf0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.522095 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-31d2f601-efb0-44e0-b562-4b3ca5cc7bf0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.632990 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-71a7393c-c4a9-4e18-a6f0-5beb1c4fc756 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:45.640964 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-71a7393c-c4a9-4e18-a6f0-5beb1c4fc756 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.318153 Aug 24 19:33:45.641543 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 340/697] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:45 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:45.645900 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-74ab4af7-c0e6-46eb-b11d-a42e0115bea1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:45.646496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-74ab4af7-c0e6-46eb-b11d-a42e0115bea1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:45.653408 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-74ab4af7-c0e6-46eb-b11d-a42e0115bea1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.654421 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-74ab4af7-c0e6-46eb-b11d-a42e0115bea1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.655616 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-74ab4af7-c0e6-46eb-b11d-a42e0115bea1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.656430 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-74ab4af7-c0e6-46eb-b11d-a42e0115bea1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.774931 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-31d2f601-efb0-44e0-b562-4b3ca5cc7bf0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:45.783385 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-31d2f601-efb0-44e0-b562-4b3ca5cc7bf0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.275338 Aug 24 19:33:45.793063 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 358/698] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:45 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:45.797825 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-04582cf2-2fea-4903-af94-fc4ca3a21ad7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:45.798470 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-04582cf2-2fea-4903-af94-fc4ca3a21ad7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:45.805819 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-04582cf2-2fea-4903-af94-fc4ca3a21ad7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.806706 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-04582cf2-2fea-4903-af94-fc4ca3a21ad7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.807494 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-04582cf2-2fea-4903-af94-fc4ca3a21ad7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.807922 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-04582cf2-2fea-4903-af94-fc4ca3a21ad7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.843275 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-04582cf2-2fea-4903-af94-fc4ca3a21ad7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.843708 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-04582cf2-2fea-4903-af94-fc4ca3a21ad7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.844146 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-04582cf2-2fea-4903-af94-fc4ca3a21ad7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lazy-loading 'fault' on Instance uuid 0b3252f0-c442-46e2-9da6-666aacad067c {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:33:45.931257 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-04582cf2-2fea-4903-af94-fc4ca3a21ad7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:45.945032 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-04582cf2-2fea-4903-af94-fc4ca3a21ad7 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 200 len: 1312 microversion: 2.1 time: 0.150154 Aug 24 19:33:45.945719 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 359/699] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:45 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:45.951857 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-74ab4af7-c0e6-46eb-b11d-a42e0115bea1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:45.962710 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-74ab4af7-c0e6-46eb-b11d-a42e0115bea1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:45.964524 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-74ab4af7-c0e6-46eb-b11d-a42e0115bea1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:45.965833 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-74ab4af7-c0e6-46eb-b11d-a42e0115bea1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1663 microversion: 2.20 time: 0.323310 Aug 24 19:33:45.966806 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 341/700] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:45 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1663 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:45.985323 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a3898da1-9af9-430d-bfc4-2cc23a62efca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55068dbe-81a4-4338-94ae-e54f25016c48"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:45.986561 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a3898da1-9af9-430d-bfc4-2cc23a62efca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:45.993441 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a3898da1-9af9-430d-bfc4-2cc23a62efca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.994010 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a3898da1-9af9-430d-bfc4-2cc23a62efca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:45.994812 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-badac36c-98a3-44ec-ab5f-3978ada63a1f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:45.995564 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a3898da1-9af9-430d-bfc4-2cc23a62efca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:45.995760 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-badac36c-98a3-44ec-ab5f-3978ada63a1f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:46.003246 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-badac36c-98a3-44ec-ab5f-3978ada63a1f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:46.003955 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-badac36c-98a3-44ec-ab5f-3978ada63a1f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:46.005062 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-badac36c-98a3-44ec-ab5f-3978ada63a1f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:46.006352 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-badac36c-98a3-44ec-ab5f-3978ada63a1f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:46.008703 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a3898da1-9af9-430d-bfc4-2cc23a62efca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:46.245604 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-badac36c-98a3-44ec-ab5f-3978ada63a1f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:46.253718 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-badac36c-98a3-44ec-ab5f-3978ada63a1f tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.262726 Aug 24 19:33:46.254286 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 342/701] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:45 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:46.457486 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1cc41345-03b9-4d4c-b49f-3322be1234ce tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:46.458007 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1cc41345-03b9-4d4c-b49f-3322be1234ce tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:46.464454 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1cc41345-03b9-4d4c-b49f-3322be1234ce tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:46.464942 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1cc41345-03b9-4d4c-b49f-3322be1234ce tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:46.465714 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1cc41345-03b9-4d4c-b49f-3322be1234ce tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:46.466170 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1cc41345-03b9-4d4c-b49f-3322be1234ce tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:46.586006 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1cc41345-03b9-4d4c-b49f-3322be1234ce tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:46.593700 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1cc41345-03b9-4d4c-b49f-3322be1234ce tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.140022 Aug 24 19:33:46.595204 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 343/702] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:46 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:46.657879 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-85fb61fa-b5b4-4a60-9c3c-4aae818d0db4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:46.658672 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-85fb61fa-b5b4-4a60-9c3c-4aae818d0db4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:46.664462 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-85fb61fa-b5b4-4a60-9c3c-4aae818d0db4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:46.664904 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-85fb61fa-b5b4-4a60-9c3c-4aae818d0db4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:46.665655 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-85fb61fa-b5b4-4a60-9c3c-4aae818d0db4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:46.666077 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-85fb61fa-b5b4-4a60-9c3c-4aae818d0db4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:46.788155 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-85fb61fa-b5b4-4a60-9c3c-4aae818d0db4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:46.795521 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-85fb61fa-b5b4-4a60-9c3c-4aae818d0db4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.141762 Aug 24 19:33:46.796081 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 344/703] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:46 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:46.800459 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-65a081fd-5791-48a8-9cdb-8d1fd48089c8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:46.801050 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-65a081fd-5791-48a8-9cdb-8d1fd48089c8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:46.806399 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65a081fd-5791-48a8-9cdb-8d1fd48089c8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:46.806841 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65a081fd-5791-48a8-9cdb-8d1fd48089c8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:46.813192 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65a081fd-5791-48a8-9cdb-8d1fd48089c8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:46.813192 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65a081fd-5791-48a8-9cdb-8d1fd48089c8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.039456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-65a081fd-5791-48a8-9cdb-8d1fd48089c8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:47.039456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-65a081fd-5791-48a8-9cdb-8d1fd48089c8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.159507 Aug 24 19:33:47.039456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 345/704] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:46 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:47.039456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9ec6594c-2183-4cdb-b2a1-98582d053af0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:47.040385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9ec6594c-2183-4cdb-b2a1-98582d053af0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 0b3252f0-c442-46e2-9da6-666aacad067c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:47.040385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9ec6594c-2183-4cdb-b2a1-98582d053af0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.040385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9ec6594c-2183-4cdb-b2a1-98582d053af0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.040385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9ec6594c-2183-4cdb-b2a1-98582d053af0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.041725 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9ec6594c-2183-4cdb-b2a1-98582d053af0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.041725 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-9ec6594c-2183-4cdb-b2a1-98582d053af0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] HTTP exception thrown: Instance 0b3252f0-c442-46e2-9da6-666aacad067c could not be found. Aug 24 19:33:47.041725 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9ec6594c-2183-4cdb-b2a1-98582d053af0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Returning 404 to user: Instance 0b3252f0-c442-46e2-9da6-666aacad067c could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:33:47.041725 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9ec6594c-2183-4cdb-b2a1-98582d053af0 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c" status: 404 len: 111 microversion: 2.1 time: 0.037611 Aug 24 19:33:47.041725 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 346/705] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:46 2021] GET /compute/v2.1/servers/0b3252f0-c442-46e2-9da6-666aacad067c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:33:47.042539 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0ecfc876-0f2a-43bf-8470-b499f173d6bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:47.042539 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0ecfc876-0f2a-43bf-8470-b499f173d6bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:47.042539 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0ecfc876-0f2a-43bf-8470-b499f173d6bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.042539 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0ecfc876-0f2a-43bf-8470-b499f173d6bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.043153 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0ecfc876-0f2a-43bf-8470-b499f173d6bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.043153 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0ecfc876-0f2a-43bf-8470-b499f173d6bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.043153 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0ecfc876-0f2a-43bf-8470-b499f173d6bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Going to try to terminate instance {{(pid=108908) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:33:47.329456 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a3898da1-9af9-430d-bfc4-2cc23a62efca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.349426 Aug 24 19:33:47.330136 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 360/706] 10.222.0.59 () {62 vars in 1364 bytes} [Tue Aug 24 19:33:45 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/os-volume_attachments => generated 188 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:33:47.335115 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-43786007-8843-4a3c-b7ec-97ab4c75fa65 req-30bbe631-366b-4f1f-8c87-00721f9633e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2057e6ea-d98d-4233-b304-42ed12ce391c", "name": "network-vif-plugged", "status": "completed", "tag": "0ce85f00-01ff-4d38-89a7-beb1609b7e9a"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:47.340557 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:47.340557 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:33:47.345751 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-43786007-8843-4a3c-b7ec-97ab4c75fa65 req-30bbe631-366b-4f1f-8c87-00721f9633e2 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.346289 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-43786007-8843-4a3c-b7ec-97ab4c75fa65 req-30bbe631-366b-4f1f-8c87-00721f9633e2 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.357496 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-43786007-8843-4a3c-b7ec-97ab4c75fa65 req-30bbe631-366b-4f1f-8c87-00721f9633e2 service nova] Creating event network-vif-plugged:0ce85f00-01ff-4d38-89a7-beb1609b7e9a for instance 2057e6ea-d98d-4233-b304-42ed12ce391c on hv-cinder-79819 Aug 24 19:33:47.369168 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-43786007-8843-4a3c-b7ec-97ab4c75fa65 req-30bbe631-366b-4f1f-8c87-00721f9633e2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030931 Aug 24 19:33:47.369168 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 361/707] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:33:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:33:47.369168 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c04710d2-d6fc-46a1-9247-182de7fea686 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:47.369168 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c04710d2-d6fc-46a1-9247-182de7fea686 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:47.375343 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c04710d2-d6fc-46a1-9247-182de7fea686 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.376005 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c04710d2-d6fc-46a1-9247-182de7fea686 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.376795 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c04710d2-d6fc-46a1-9247-182de7fea686 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.377732 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c04710d2-d6fc-46a1-9247-182de7fea686 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.478837 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0ecfc876-0f2a-43bf-8470-b499f173d6bd tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "DELETE /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 204 len: 0 microversion: 2.1 time: 0.476062 Aug 24 19:33:47.484753 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 347/708] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:33:47 2021] DELETE /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:33:47.485685 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9759dbce-3b30-447b-abee-7be15708dce5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:47.486646 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9759dbce-3b30-447b-abee-7be15708dce5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:47.492748 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9759dbce-3b30-447b-abee-7be15708dce5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.493199 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9759dbce-3b30-447b-abee-7be15708dce5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.493976 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9759dbce-3b30-447b-abee-7be15708dce5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.494405 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9759dbce-3b30-447b-abee-7be15708dce5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.504294 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c04710d2-d6fc-46a1-9247-182de7fea686 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:47.512612 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c04710d2-d6fc-46a1-9247-182de7fea686 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.148456 Aug 24 19:33:47.518833 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 362/709] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:47 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:47.518833 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-bdec1a18-037f-49e3-95fd-f060ddba55d4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:47.518833 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-bdec1a18-037f-49e3-95fd-f060ddba55d4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:47.524521 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bdec1a18-037f-49e3-95fd-f060ddba55d4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.525023 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bdec1a18-037f-49e3-95fd-f060ddba55d4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.525791 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bdec1a18-037f-49e3-95fd-f060ddba55d4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.526218 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bdec1a18-037f-49e3-95fd-f060ddba55d4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.650727 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-bdec1a18-037f-49e3-95fd-f060ddba55d4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:47.658086 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-bdec1a18-037f-49e3-95fd-f060ddba55d4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.143910 Aug 24 19:33:47.658646 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 363/710] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:47 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:47.663146 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ff018154-7402-4df0-9f88-e4fe4d133909 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:47.663736 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ff018154-7402-4df0-9f88-e4fe4d133909 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:47.669215 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ff018154-7402-4df0-9f88-e4fe4d133909 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.670198 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ff018154-7402-4df0-9f88-e4fe4d133909 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.670942 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ff018154-7402-4df0-9f88-e4fe4d133909 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.671368 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ff018154-7402-4df0-9f88-e4fe4d133909 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.818470 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9759dbce-3b30-447b-abee-7be15708dce5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action" status: 202 len: 0 microversion: 2.20 time: 0.337258 Aug 24 19:33:47.822347 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 348/711] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:33:47 2021] POST /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:33:47.825000 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-7a45043f-fd2b-46a7-abc8-5196d9f39838 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:47.826390 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-7a45043f-fd2b-46a7-abc8-5196d9f39838 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:47.827629 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ff018154-7402-4df0-9f88-e4fe4d133909 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:47.833854 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7a45043f-fd2b-46a7-abc8-5196d9f39838 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.834558 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7a45043f-fd2b-46a7-abc8-5196d9f39838 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.835807 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7a45043f-fd2b-46a7-abc8-5196d9f39838 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.836550 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7a45043f-fd2b-46a7-abc8-5196d9f39838 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.837339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ff018154-7402-4df0-9f88-e4fe4d133909 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.177653 Aug 24 19:33:47.847110 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 364/712] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:47 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:47.847110 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-3853f0d8-d171-4d37-91fa-76e1713dc11a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:47.847110 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3853f0d8-d171-4d37-91fa-76e1713dc11a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:47.851575 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3853f0d8-d171-4d37-91fa-76e1713dc11a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.857751 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3853f0d8-d171-4d37-91fa-76e1713dc11a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:47.857751 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3853f0d8-d171-4d37-91fa-76e1713dc11a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:47.857751 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3853f0d8-d171-4d37-91fa-76e1713dc11a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:48.030691 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-7a45043f-fd2b-46a7-abc8-5196d9f39838 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:48.037863 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3853f0d8-d171-4d37-91fa-76e1713dc11a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:48.043611 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-7a45043f-fd2b-46a7-abc8-5196d9f39838 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.223051 Aug 24 19:33:48.044199 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 349/713] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:47 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:48.046322 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3853f0d8-d171-4d37-91fa-76e1713dc11a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:48.047827 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3853f0d8-d171-4d37-91fa-76e1713dc11a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:48.049191 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-3853f0d8-d171-4d37-91fa-76e1713dc11a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1749 microversion: 2.20 time: 0.210294 Aug 24 19:33:48.049322 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-01e9fae3-b7c1-451a-98d6-ec1fd320b2e0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:48.049912 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 365/714] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:47 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1749 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:48.050036 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-01e9fae3-b7c1-451a-98d6-ec1fd320b2e0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:48.055471 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-01e9fae3-b7c1-451a-98d6-ec1fd320b2e0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:48.056119 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-01e9fae3-b7c1-451a-98d6-ec1fd320b2e0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:48.057003 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-01e9fae3-b7c1-451a-98d6-ec1fd320b2e0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:48.057432 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-01e9fae3-b7c1-451a-98d6-ec1fd320b2e0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:48.178235 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-01e9fae3-b7c1-451a-98d6-ec1fd320b2e0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:48.186113 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-01e9fae3-b7c1-451a-98d6-ec1fd320b2e0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1358 microversion: 2.1 time: 0.140683 Aug 24 19:33:48.186677 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 350/715] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:48 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1358 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:48.533601 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-88bcd343-0cd1-4c76-a010-ced0a18cb831 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:48.535905 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-88bcd343-0cd1-4c76-a010-ced0a18cb831 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:48.540297 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-88bcd343-0cd1-4c76-a010-ced0a18cb831 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:48.540665 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-88bcd343-0cd1-4c76-a010-ced0a18cb831 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:48.541421 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-88bcd343-0cd1-4c76-a010-ced0a18cb831 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:48.541845 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-88bcd343-0cd1-4c76-a010-ced0a18cb831 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:48.666390 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-88bcd343-0cd1-4c76-a010-ced0a18cb831 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:48.674276 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-88bcd343-0cd1-4c76-a010-ced0a18cb831 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.144192 Aug 24 19:33:48.674763 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 366/716] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:48 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:48.675665 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f1869841-fc77-4cbc-ace2-da80019dcbde tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:48.676421 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f1869841-fc77-4cbc-ace2-da80019dcbde tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:48.683867 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f1869841-fc77-4cbc-ace2-da80019dcbde tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:48.684720 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f1869841-fc77-4cbc-ace2-da80019dcbde tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:48.686311 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f1869841-fc77-4cbc-ace2-da80019dcbde tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:48.687054 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f1869841-fc77-4cbc-ace2-da80019dcbde tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:48.814032 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f1869841-fc77-4cbc-ace2-da80019dcbde tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:48.821363 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f1869841-fc77-4cbc-ace2-da80019dcbde tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.149709 Aug 24 19:33:48.822566 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 351/717] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:48 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:48.853467 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-70a60a2a-9598-46da-a5db-fc88a7b3ca8e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:48.854074 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-70a60a2a-9598-46da-a5db-fc88a7b3ca8e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:48.860789 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-70a60a2a-9598-46da-a5db-fc88a7b3ca8e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:48.861238 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-70a60a2a-9598-46da-a5db-fc88a7b3ca8e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:48.862006 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-70a60a2a-9598-46da-a5db-fc88a7b3ca8e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:48.862436 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-70a60a2a-9598-46da-a5db-fc88a7b3ca8e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.021859 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-70a60a2a-9598-46da-a5db-fc88a7b3ca8e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:49.030490 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-70a60a2a-9598-46da-a5db-fc88a7b3ca8e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.180594 Aug 24 19:33:49.031077 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 367/718] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:48 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:49.061468 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a7486265-a29c-491d-a6e8-0f2c9747260c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:49.062319 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a7486265-a29c-491d-a6e8-0f2c9747260c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:49.068807 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a7486265-a29c-491d-a6e8-0f2c9747260c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.069253 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a7486265-a29c-491d-a6e8-0f2c9747260c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.070032 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a7486265-a29c-491d-a6e8-0f2c9747260c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.070376 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-451b8aaf-65d4-4a26-95fd-694a04c902a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:49.070488 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a7486265-a29c-491d-a6e8-0f2c9747260c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.071049 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-451b8aaf-65d4-4a26-95fd-694a04c902a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:49.078962 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-451b8aaf-65d4-4a26-95fd-694a04c902a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.079567 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-451b8aaf-65d4-4a26-95fd-694a04c902a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.080378 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-451b8aaf-65d4-4a26-95fd-694a04c902a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.080823 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-451b8aaf-65d4-4a26-95fd-694a04c902a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.265097 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a7486265-a29c-491d-a6e8-0f2c9747260c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:49.268083 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-451b8aaf-65d4-4a26-95fd-694a04c902a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:49.274660 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a7486265-a29c-491d-a6e8-0f2c9747260c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.217192 Aug 24 19:33:49.275278 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 352/719] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:49 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:49.280899 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-451b8aaf-65d4-4a26-95fd-694a04c902a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:49.282382 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-451b8aaf-65d4-4a26-95fd-694a04c902a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:49.283528 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-451b8aaf-65d4-4a26-95fd-694a04c902a4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1749 microversion: 2.20 time: 0.220291 Aug 24 19:33:49.284084 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 368/720] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:49 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1749 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:33:49.285815 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9655d460-84df-471e-81c3-0026e755ccb8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:49.286455 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9655d460-84df-471e-81c3-0026e755ccb8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:49.293837 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9655d460-84df-471e-81c3-0026e755ccb8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.294779 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9655d460-84df-471e-81c3-0026e755ccb8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.295563 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9655d460-84df-471e-81c3-0026e755ccb8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.296001 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9655d460-84df-471e-81c3-0026e755ccb8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.376946 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-75d75459-7459-4e1a-9f2b-591cf02833d5 req-ebf168ea-78d2-44b3-9162-fc40dbd61c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71966c1-f9be-4c1c-b1b3-0b9b87351800", "name": "network-vif-plugged", "status": "completed", "tag": "22b31ca4-ca4d-4def-b031-033feec3b7b6"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:49.378980 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:49.378980 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:33:49.385936 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-75d75459-7459-4e1a-9f2b-591cf02833d5 req-ebf168ea-78d2-44b3-9162-fc40dbd61c13 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.386371 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-75d75459-7459-4e1a-9f2b-591cf02833d5 req-ebf168ea-78d2-44b3-9162-fc40dbd61c13 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.397930 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-75d75459-7459-4e1a-9f2b-591cf02833d5 req-ebf168ea-78d2-44b3-9162-fc40dbd61c13 service nova] Creating event network-vif-plugged:22b31ca4-ca4d-4def-b031-033feec3b7b6 for instance b71966c1-f9be-4c1c-b1b3-0b9b87351800 on hv-cinder-79819 Aug 24 19:33:49.404903 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-75d75459-7459-4e1a-9f2b-591cf02833d5 req-ebf168ea-78d2-44b3-9162-fc40dbd61c13 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031720 Aug 24 19:33:49.408956 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 369/721] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:33:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:33:49.422535 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9655d460-84df-471e-81c3-0026e755ccb8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:49.435685 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9655d460-84df-471e-81c3-0026e755ccb8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1548 microversion: 2.1 time: 0.159013 Aug 24 19:33:49.436384 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 353/722] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:49 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:49.453076 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-30c584f4-80bf-499f-ad17-d59518985194 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:49.453592 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-30c584f4-80bf-499f-ad17-d59518985194 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:49.459742 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-30c584f4-80bf-499f-ad17-d59518985194 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.460182 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-30c584f4-80bf-499f-ad17-d59518985194 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.460980 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-30c584f4-80bf-499f-ad17-d59518985194 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.461411 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-30c584f4-80bf-499f-ad17-d59518985194 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.585869 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-30c584f4-80bf-499f-ad17-d59518985194 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:49.593751 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-30c584f4-80bf-499f-ad17-d59518985194 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1548 microversion: 2.1 time: 0.144925 Aug 24 19:33:49.594315 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 370/723] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:49 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:49.609655 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6056403e-5939-471c-b5ce-8510c95e4ce5 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:49.619165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:49.619165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:33:49.619165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6056403e-5939-471c-b5ce-8510c95e4ce5 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:49.619165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6056403e-5939-471c-b5ce-8510c95e4ce5 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Searching by: {'deleted': False, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a'} {{(pid=108908) get_all /opt/stack/nova/nova/compute/api.py:2867}} Aug 24 19:33:49.621262 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6056403e-5939-471c-b5ce-8510c95e4ce5 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.621767 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6056403e-5939-471c-b5ce-8510c95e4ce5 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.622552 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6056403e-5939-471c-b5ce-8510c95e4ce5 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.622973 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6056403e-5939-471c-b5ce-8510c95e4ce5 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.690851 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-2101f641-e551-4234-ab0e-dfd062595d5b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:49.691562 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-2101f641-e551-4234-ab0e-dfd062595d5b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:49.698019 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2101f641-e551-4234-ab0e-dfd062595d5b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.698506 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2101f641-e551-4234-ab0e-dfd062595d5b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.699365 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2101f641-e551-4234-ab0e-dfd062595d5b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.699823 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2101f641-e551-4234-ab0e-dfd062595d5b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.717140 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.multi_cell_list [None req-6056403e-5939-471c-b5ce-8510c95e4ce5 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108908) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 24 19:33:49.824311 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6056403e-5939-471c-b5ce-8510c95e4ce5 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210312 Aug 24 19:33:49.824311 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 354/724] 10.222.0.59 () {58 vars in 1125 bytes} [Tue Aug 24 19:33:49 2021] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:33:49.829201 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-303aea94-5c85-4ce6-abe1-3a9654cf6e48 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:49.829807 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-303aea94-5c85-4ce6-abe1-3a9654cf6e48 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:49.837526 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-303aea94-5c85-4ce6-abe1-3a9654cf6e48 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.837971 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-303aea94-5c85-4ce6-abe1-3a9654cf6e48 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.838924 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-303aea94-5c85-4ce6-abe1-3a9654cf6e48 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.839512 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-303aea94-5c85-4ce6-abe1-3a9654cf6e48 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.896021 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2101f641-e551-4234-ab0e-dfd062595d5b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:49.914329 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-2101f641-e551-4234-ab0e-dfd062595d5b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.216554 Aug 24 19:33:49.914329 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 371/725] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:49 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:49.914329 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6a73d9d6-fe7b-4520-a131-2e515bcac4b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:49.914329 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6a73d9d6-fe7b-4520-a131-2e515bcac4b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:49.919731 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6a73d9d6-fe7b-4520-a131-2e515bcac4b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.920258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6a73d9d6-fe7b-4520-a131-2e515bcac4b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:49.921122 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6a73d9d6-fe7b-4520-a131-2e515bcac4b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:49.921605 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6a73d9d6-fe7b-4520-a131-2e515bcac4b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:50.005179 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-303aea94-5c85-4ce6-abe1-3a9654cf6e48 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:50.013486 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-303aea94-5c85-4ce6-abe1-3a9654cf6e48 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1548 microversion: 2.1 time: 0.187451 Aug 24 19:33:50.014346 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 355/726] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:49 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1548 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:50.047439 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-05710871-53eb-4052-863d-e9f5d4016cd1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:50.048246 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-05710871-53eb-4052-863d-e9f5d4016cd1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:50.054094 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05710871-53eb-4052-863d-e9f5d4016cd1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:50.054543 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05710871-53eb-4052-863d-e9f5d4016cd1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:50.055245 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05710871-53eb-4052-863d-e9f5d4016cd1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:50.055667 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05710871-53eb-4052-863d-e9f5d4016cd1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:50.065441 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6a73d9d6-fe7b-4520-a131-2e515bcac4b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:50.073039 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6a73d9d6-fe7b-4520-a131-2e515bcac4b4 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.166804 Aug 24 19:33:50.074340 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 372/727] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:49 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:50.182701 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-05710871-53eb-4052-863d-e9f5d4016cd1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:50.190155 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-05710871-53eb-4052-863d-e9f5d4016cd1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.146951 Aug 24 19:33:50.191288 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 356/728] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:50 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:50.291616 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4a3283b9-9c24-4152-af1c-76e7009b4d85 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:50.292128 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4a3283b9-9c24-4152-af1c-76e7009b4d85 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:50.297912 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4a3283b9-9c24-4152-af1c-76e7009b4d85 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:50.298468 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4a3283b9-9c24-4152-af1c-76e7009b4d85 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:50.299233 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4a3283b9-9c24-4152-af1c-76e7009b4d85 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:50.299662 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4a3283b9-9c24-4152-af1c-76e7009b4d85 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:50.306686 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1b12db21-c8c3-4c25-affa-97b772c3579d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:50.307285 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1b12db21-c8c3-4c25-affa-97b772c3579d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:50.313690 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1b12db21-c8c3-4c25-affa-97b772c3579d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:50.314128 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1b12db21-c8c3-4c25-affa-97b772c3579d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:50.314887 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1b12db21-c8c3-4c25-affa-97b772c3579d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:50.315307 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1b12db21-c8c3-4c25-affa-97b772c3579d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:50.473428 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4a3283b9-9c24-4152-af1c-76e7009b4d85 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:50.481059 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4a3283b9-9c24-4152-af1c-76e7009b4d85 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.193274 Aug 24 19:33:50.482350 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 373/729] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:50 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:50.495578 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1b12db21-c8c3-4c25-affa-97b772c3579d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:50.505308 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1b12db21-c8c3-4c25-affa-97b772c3579d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:50.507895 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1b12db21-c8c3-4c25-affa-97b772c3579d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:50.508642 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1b12db21-c8c3-4c25-affa-97b772c3579d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1751 microversion: 2.20 time: 0.205859 Aug 24 19:33:50.509385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 357/730] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:50 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1751 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:33:50.921564 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-cb49d332-755a-4b2a-a2dd-f6d6558469ec tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:50.922163 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-cb49d332-755a-4b2a-a2dd-f6d6558469ec tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:50.927958 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cb49d332-755a-4b2a-a2dd-f6d6558469ec tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:50.928429 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cb49d332-755a-4b2a-a2dd-f6d6558469ec tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:50.929185 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cb49d332-755a-4b2a-a2dd-f6d6558469ec tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:50.929605 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cb49d332-755a-4b2a-a2dd-f6d6558469ec tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:51.051147 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-cb49d332-755a-4b2a-a2dd-f6d6558469ec tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:51.058329 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-cb49d332-755a-4b2a-a2dd-f6d6558469ec tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1314 microversion: 2.1 time: 0.140401 Aug 24 19:33:51.062466 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 374/731] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:50 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1314 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:51.089674 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-507bed4a-6341-421a-9d2c-7e36b30f675d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:51.090283 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-507bed4a-6341-421a-9d2c-7e36b30f675d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:51.096065 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-507bed4a-6341-421a-9d2c-7e36b30f675d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:51.096550 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-507bed4a-6341-421a-9d2c-7e36b30f675d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:51.097306 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-507bed4a-6341-421a-9d2c-7e36b30f675d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:51.097736 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-507bed4a-6341-421a-9d2c-7e36b30f675d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:51.212301 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-47cf5c0b-c802-43f2-a0e8-56703804054d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:51.213001 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-47cf5c0b-c802-43f2-a0e8-56703804054d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:51.221922 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-47cf5c0b-c802-43f2-a0e8-56703804054d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:51.222795 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-47cf5c0b-c802-43f2-a0e8-56703804054d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:51.224962 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-47cf5c0b-c802-43f2-a0e8-56703804054d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:51.225390 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-47cf5c0b-c802-43f2-a0e8-56703804054d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:51.238332 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-507bed4a-6341-421a-9d2c-7e36b30f675d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:51.247844 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-507bed4a-6341-421a-9d2c-7e36b30f675d tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.160891 Aug 24 19:33:51.248775 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 358/732] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:51 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:51.384656 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-47cf5c0b-c802-43f2-a0e8-56703804054d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:51.384656 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-47cf5c0b-c802-43f2-a0e8-56703804054d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.163734 Aug 24 19:33:51.384656 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 375/733] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:51 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:51.498277 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-23820c06-4088-4263-909a-a003f2e7af02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:51.498883 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-23820c06-4088-4263-909a-a003f2e7af02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:51.504818 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-23820c06-4088-4263-909a-a003f2e7af02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:51.505258 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-23820c06-4088-4263-909a-a003f2e7af02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:51.506019 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-23820c06-4088-4263-909a-a003f2e7af02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:51.506445 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-23820c06-4088-4263-909a-a003f2e7af02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:51.526601 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-60415fdd-b040-4ea2-a608-2b62bf3b0e42 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:51.527213 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-60415fdd-b040-4ea2-a608-2b62bf3b0e42 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:51.533335 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-60415fdd-b040-4ea2-a608-2b62bf3b0e42 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:51.533895 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-60415fdd-b040-4ea2-a608-2b62bf3b0e42 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:51.534737 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-60415fdd-b040-4ea2-a608-2b62bf3b0e42 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:51.535600 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-60415fdd-b040-4ea2-a608-2b62bf3b0e42 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:51.680211 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-23820c06-4088-4263-909a-a003f2e7af02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:51.687816 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-23820c06-4088-4263-909a-a003f2e7af02 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.193871 Aug 24 19:33:51.688632 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 359/734] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:51 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:51.699867 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-60415fdd-b040-4ea2-a608-2b62bf3b0e42 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:51.709195 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-60415fdd-b040-4ea2-a608-2b62bf3b0e42 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:51.710710 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-60415fdd-b040-4ea2-a608-2b62bf3b0e42 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:51.711847 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-60415fdd-b040-4ea2-a608-2b62bf3b0e42 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1751 microversion: 2.20 time: 0.188880 Aug 24 19:33:51.712602 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 376/735] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:51 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:33:52.032478 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-cede950b-e575-468f-886a-39a6cec8892f tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d278094e-49ee-43d8-a17e-3cb1f9cb1774"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:52.033525 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-cede950b-e575-468f-886a-39a6cec8892f tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:52.039456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cede950b-e575-468f-886a-39a6cec8892f tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:52.039901 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cede950b-e575-468f-886a-39a6cec8892f tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:52.040976 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cede950b-e575-468f-886a-39a6cec8892f tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:52.041154 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cede950b-e575-468f-886a-39a6cec8892f tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:52.076207 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9203ea4e-1a8b-412d-a2ed-78640a6c5cd2 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:52.076835 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9203ea4e-1a8b-412d-a2ed-78640a6c5cd2 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:52.089603 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9203ea4e-1a8b-412d-a2ed-78640a6c5cd2 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:52.090046 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9203ea4e-1a8b-412d-a2ed-78640a6c5cd2 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:52.091620 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9203ea4e-1a8b-412d-a2ed-78640a6c5cd2 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:52.092057 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9203ea4e-1a8b-412d-a2ed-78640a6c5cd2 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:52.270174 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9203ea4e-1a8b-412d-a2ed-78640a6c5cd2 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:52.277345 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9203ea4e-1a8b-412d-a2ed-78640a6c5cd2 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1498 microversion: 2.1 time: 0.205209 Aug 24 19:33:52.277904 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 377/736] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:52 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1498 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:52.282930 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c99c1836-be2e-488c-b917-9e114c205106 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:52.283460 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c99c1836-be2e-488c-b917-9e114c205106 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:52.289499 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c99c1836-be2e-488c-b917-9e114c205106 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:52.291117 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c99c1836-be2e-488c-b917-9e114c205106 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:52.291894 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c99c1836-be2e-488c-b917-9e114c205106 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:52.292344 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c99c1836-be2e-488c-b917-9e114c205106 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:52.510807 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c99c1836-be2e-488c-b917-9e114c205106 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:52.531500 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c99c1836-be2e-488c-b917-9e114c205106 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.251994 Aug 24 19:33:52.532120 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 378/737] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:52 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:52.536809 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a4ca6855-bf07-4ddc-8c30-62c9b730c684 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:52.537585 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a4ca6855-bf07-4ddc-8c30-62c9b730c684 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:52.544847 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a4ca6855-bf07-4ddc-8c30-62c9b730c684 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:52.544847 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a4ca6855-bf07-4ddc-8c30-62c9b730c684 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:52.545700 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a4ca6855-bf07-4ddc-8c30-62c9b730c684 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:52.546129 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a4ca6855-bf07-4ddc-8c30-62c9b730c684 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:52.744919 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a4ca6855-bf07-4ddc-8c30-62c9b730c684 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:52.752549 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a4ca6855-bf07-4ddc-8c30-62c9b730c684 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.219201 Aug 24 19:33:52.753193 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 379/738] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:52 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:52.757506 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-010e771b-ed6e-466a-9ee4-773de7d4ff9e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:52.758165 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-010e771b-ed6e-466a-9ee4-773de7d4ff9e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:52.764749 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-010e771b-ed6e-466a-9ee4-773de7d4ff9e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:52.765273 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-010e771b-ed6e-466a-9ee4-773de7d4ff9e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:52.766102 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-010e771b-ed6e-466a-9ee4-773de7d4ff9e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:52.766760 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-010e771b-ed6e-466a-9ee4-773de7d4ff9e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:52.957108 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-010e771b-ed6e-466a-9ee4-773de7d4ff9e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:52.964338 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-010e771b-ed6e-466a-9ee4-773de7d4ff9e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.210121 Aug 24 19:33:52.964904 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 380/739] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:52 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:52.969663 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e35a7a0b-9de3-4c74-a103-20edf8b5c4bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:52.970257 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e35a7a0b-9de3-4c74-a103-20edf8b5c4bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:52.976162 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e35a7a0b-9de3-4c74-a103-20edf8b5c4bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:52.976659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e35a7a0b-9de3-4c74-a103-20edf8b5c4bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:52.977447 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e35a7a0b-9de3-4c74-a103-20edf8b5c4bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:52.977879 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e35a7a0b-9de3-4c74-a103-20edf8b5c4bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:53.036454 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-cede950b-e575-468f-886a-39a6cec8892f tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "POST /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.008185 Aug 24 19:33:53.059223 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 360/740] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 24 19:33:52 2021] POST /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/os-volume_attachments => generated 194 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:33:53.107937 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e35a7a0b-9de3-4c74-a103-20edf8b5c4bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:53.116539 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e35a7a0b-9de3-4c74-a103-20edf8b5c4bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:53.118037 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e35a7a0b-9de3-4c74-a103-20edf8b5c4bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:53.119167 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e35a7a0b-9de3-4c74-a103-20edf8b5c4bc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.153358 Aug 24 19:33:53.119717 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 381/741] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:52 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:53.394164 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-928926e3-0b2c-449f-b8da-79d5a875f634 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:53.394520 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-928926e3-0b2c-449f-b8da-79d5a875f634 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:53.401822 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-928926e3-0b2c-449f-b8da-79d5a875f634 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:53.402270 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-928926e3-0b2c-449f-b8da-79d5a875f634 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:53.403129 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-928926e3-0b2c-449f-b8da-79d5a875f634 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:53.403565 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-928926e3-0b2c-449f-b8da-79d5a875f634 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:53.427973 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-928926e3-0b2c-449f-b8da-79d5a875f634 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Going to try to terminate instance {{(pid=108908) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:33:53.549110 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-70d4902f-452e-4eb1-b5be-ead10d803998 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:53.549659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-70d4902f-452e-4eb1-b5be-ead10d803998 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:53.555507 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-70d4902f-452e-4eb1-b5be-ead10d803998 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:53.555950 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-70d4902f-452e-4eb1-b5be-ead10d803998 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:53.556742 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-70d4902f-452e-4eb1-b5be-ead10d803998 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:53.557175 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-70d4902f-452e-4eb1-b5be-ead10d803998 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:53.701135 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-70d4902f-452e-4eb1-b5be-ead10d803998 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:53.710460 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-70d4902f-452e-4eb1-b5be-ead10d803998 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.164967 Aug 24 19:33:53.731723 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 382/742] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:53 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:53.772665 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8f07242a-a199-44a5-98d9-8bea88efd745 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:53.774035 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8f07242a-a199-44a5-98d9-8bea88efd745 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:53.813736 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f07242a-a199-44a5-98d9-8bea88efd745 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:53.815708 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f07242a-a199-44a5-98d9-8bea88efd745 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:53.819539 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f07242a-a199-44a5-98d9-8bea88efd745 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:53.822092 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f07242a-a199-44a5-98d9-8bea88efd745 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:53.980690 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-928926e3-0b2c-449f-b8da-79d5a875f634 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 204 len: 0 microversion: 2.1 time: 0.591134 Aug 24 19:33:53.982245 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 361/743] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:33:53 2021] DELETE /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:33:53.988723 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2fc87143-5148-44db-884e-582e747310a7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:53.990606 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2fc87143-5148-44db-884e-582e747310a7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:53.997853 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2fc87143-5148-44db-884e-582e747310a7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:53.998587 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2fc87143-5148-44db-884e-582e747310a7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:53.999576 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2fc87143-5148-44db-884e-582e747310a7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:54.000176 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2fc87143-5148-44db-884e-582e747310a7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:54.349046 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8f07242a-a199-44a5-98d9-8bea88efd745 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:54.354923 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8f07242a-a199-44a5-98d9-8bea88efd745 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.588703 Aug 24 19:33:54.359626 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-2fc87143-5148-44db-884e-582e747310a7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:54.360996 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 383/744] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:53 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:54.366877 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7698b4cd-82b7-41e8-876a-7712e155f6e4 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:54.368305 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7698b4cd-82b7-41e8-876a-7712e155f6e4 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:54.375418 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2fc87143-5148-44db-884e-582e747310a7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.391950 Aug 24 19:33:54.383682 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7698b4cd-82b7-41e8-876a-7712e155f6e4 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:54.383682 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7698b4cd-82b7-41e8-876a-7712e155f6e4 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:54.383682 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7698b4cd-82b7-41e8-876a-7712e155f6e4 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:54.383682 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7698b4cd-82b7-41e8-876a-7712e155f6e4 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:54.384661 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 362/745] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:53 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:54.390431 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-46581c61-cda8-4c7d-b77f-4b10313f29dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:54.394428 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-46581c61-cda8-4c7d-b77f-4b10313f29dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:54.398206 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46581c61-cda8-4c7d-b77f-4b10313f29dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:54.398873 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46581c61-cda8-4c7d-b77f-4b10313f29dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:54.399657 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46581c61-cda8-4c7d-b77f-4b10313f29dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:54.400136 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46581c61-cda8-4c7d-b77f-4b10313f29dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:54.585070 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7698b4cd-82b7-41e8-876a-7712e155f6e4 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:54.593810 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7698b4cd-82b7-41e8-876a-7712e155f6e4 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1504 microversion: 2.1 time: 0.231555 Aug 24 19:33:54.594427 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 384/746] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:54 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:54.605745 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-46581c61-cda8-4c7d-b77f-4b10313f29dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:54.614600 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-46581c61-cda8-4c7d-b77f-4b10313f29dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:54.616104 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-46581c61-cda8-4c7d-b77f-4b10313f29dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:54.617303 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-46581c61-cda8-4c7d-b77f-4b10313f29dd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.231377 Aug 24 19:33:54.617858 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 363/747] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:54 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:54.733730 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e81b794e-c98c-4a1a-99f0-6d8ed69fa98b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:54.734425 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e81b794e-c98c-4a1a-99f0-6d8ed69fa98b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:54.740906 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e81b794e-c98c-4a1a-99f0-6d8ed69fa98b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:54.741466 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e81b794e-c98c-4a1a-99f0-6d8ed69fa98b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:54.742384 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e81b794e-c98c-4a1a-99f0-6d8ed69fa98b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:54.742888 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e81b794e-c98c-4a1a-99f0-6d8ed69fa98b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:54.935791 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e81b794e-c98c-4a1a-99f0-6d8ed69fa98b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:54.947614 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e81b794e-c98c-4a1a-99f0-6d8ed69fa98b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.218161 Aug 24 19:33:54.968445 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 385/748] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:54 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:55.387180 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-36d27748-9960-446a-a33a-4cc0983f9beb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:55.387180 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-36d27748-9960-446a-a33a-4cc0983f9beb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:55.387180 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-36d27748-9960-446a-a33a-4cc0983f9beb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:55.387180 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-36d27748-9960-446a-a33a-4cc0983f9beb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:55.387950 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-36d27748-9960-446a-a33a-4cc0983f9beb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:55.387950 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-36d27748-9960-446a-a33a-4cc0983f9beb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:55.394500 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-3e2bbcda-61ac-41ed-9b72-0d22f88098c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:55.395955 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3e2bbcda-61ac-41ed-9b72-0d22f88098c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:55.404227 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3e2bbcda-61ac-41ed-9b72-0d22f88098c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:55.405103 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3e2bbcda-61ac-41ed-9b72-0d22f88098c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:55.405832 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3e2bbcda-61ac-41ed-9b72-0d22f88098c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:55.406421 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3e2bbcda-61ac-41ed-9b72-0d22f88098c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:55.684983 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-36d27748-9960-446a-a33a-4cc0983f9beb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:55.701206 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-36d27748-9960-446a-a33a-4cc0983f9beb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.331545 Aug 24 19:33:55.706292 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 364/749] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:55 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:55.711220 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-782aff4b-dd31-4d55-b158-828d77b6442d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:55.715011 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-782aff4b-dd31-4d55-b158-828d77b6442d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:55.726414 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3e2bbcda-61ac-41ed-9b72-0d22f88098c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:55.730207 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-782aff4b-dd31-4d55-b158-828d77b6442d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:55.730858 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-782aff4b-dd31-4d55-b158-828d77b6442d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:55.741262 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-782aff4b-dd31-4d55-b158-828d77b6442d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:55.742451 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-782aff4b-dd31-4d55-b158-828d77b6442d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:55.746629 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-3e2bbcda-61ac-41ed-9b72-0d22f88098c7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.356350 Aug 24 19:33:55.755755 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 386/750] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:55 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:55.759558 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-02b95293-4fdf-4c7d-83b3-a67ab9cfdc61 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:55.760172 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-02b95293-4fdf-4c7d-83b3-a67ab9cfdc61 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:55.782461 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-02b95293-4fdf-4c7d-83b3-a67ab9cfdc61 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:55.782903 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-02b95293-4fdf-4c7d-83b3-a67ab9cfdc61 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:55.783745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-02b95293-4fdf-4c7d-83b3-a67ab9cfdc61 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:55.784177 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-02b95293-4fdf-4c7d-83b3-a67ab9cfdc61 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:55.991583 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-782aff4b-dd31-4d55-b158-828d77b6442d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:56.000339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-02b95293-4fdf-4c7d-83b3-a67ab9cfdc61 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:56.003202 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-782aff4b-dd31-4d55-b158-828d77b6442d tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1504 microversion: 2.1 time: 0.295702 Aug 24 19:33:56.007575 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 365/751] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:55 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1504 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:56.010177 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-02b95293-4fdf-4c7d-83b3-a67ab9cfdc61 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:56.011809 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-02b95293-4fdf-4c7d-83b3-a67ab9cfdc61 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:56.013672 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-02b95293-4fdf-4c7d-83b3-a67ab9cfdc61 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.265520 Aug 24 19:33:56.014901 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 387/752] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:55 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:56.025092 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e0b417ab-dbbc-40c5-9bd3-b54b662d2ad8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:56.025854 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e0b417ab-dbbc-40c5-9bd3-b54b662d2ad8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:56.032837 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e0b417ab-dbbc-40c5-9bd3-b54b662d2ad8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:56.033607 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e0b417ab-dbbc-40c5-9bd3-b54b662d2ad8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:56.035028 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e0b417ab-dbbc-40c5-9bd3-b54b662d2ad8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:56.045028 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e0b417ab-dbbc-40c5-9bd3-b54b662d2ad8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:56.176123 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e0b417ab-dbbc-40c5-9bd3-b54b662d2ad8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:56.183665 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e0b417ab-dbbc-40c5-9bd3-b54b662d2ad8 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.174714 Aug 24 19:33:56.184833 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 366/753] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:56 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:56.723627 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-73bd0bd4-75d6-41a1-bf68-a3ee7c8f26e2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:56.724532 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-73bd0bd4-75d6-41a1-bf68-a3ee7c8f26e2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:56.732604 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-73bd0bd4-75d6-41a1-bf68-a3ee7c8f26e2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:56.732604 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-73bd0bd4-75d6-41a1-bf68-a3ee7c8f26e2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:56.733035 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-73bd0bd4-75d6-41a1-bf68-a3ee7c8f26e2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:56.733485 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-73bd0bd4-75d6-41a1-bf68-a3ee7c8f26e2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:56.764986 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-52c5cfeb-07f5-42e4-a695-6c56697be66e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:56.765639 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-52c5cfeb-07f5-42e4-a695-6c56697be66e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:56.772313 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52c5cfeb-07f5-42e4-a695-6c56697be66e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:56.778149 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52c5cfeb-07f5-42e4-a695-6c56697be66e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:56.779399 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52c5cfeb-07f5-42e4-a695-6c56697be66e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:56.784573 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52c5cfeb-07f5-42e4-a695-6c56697be66e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:56.959742 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-73bd0bd4-75d6-41a1-bf68-a3ee7c8f26e2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:56.968504 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-73bd0bd4-75d6-41a1-bf68-a3ee7c8f26e2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.248963 Aug 24 19:33:56.971544 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 388/754] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:56 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:56.994184 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-52c5cfeb-07f5-42e4-a695-6c56697be66e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:57.002300 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-52c5cfeb-07f5-42e4-a695-6c56697be66e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.240884 Aug 24 19:33:57.002890 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 367/755] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:56 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:57.032129 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fe1dd206-e559-4125-b544-629d3432ff39 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:57.032972 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fe1dd206-e559-4125-b544-629d3432ff39 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:57.041442 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fe1dd206-e559-4125-b544-629d3432ff39 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:57.042838 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fe1dd206-e559-4125-b544-629d3432ff39 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:57.046261 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4bbf9325-bb31-47f5-9aad-46dfde62e0b6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:57.047792 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4bbf9325-bb31-47f5-9aad-46dfde62e0b6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:57.051250 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fe1dd206-e559-4125-b544-629d3432ff39 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:57.051964 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fe1dd206-e559-4125-b544-629d3432ff39 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:57.055011 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4bbf9325-bb31-47f5-9aad-46dfde62e0b6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:57.056524 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4bbf9325-bb31-47f5-9aad-46dfde62e0b6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:57.057666 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4bbf9325-bb31-47f5-9aad-46dfde62e0b6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:57.059134 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4bbf9325-bb31-47f5-9aad-46dfde62e0b6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:57.269501 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fe1dd206-e559-4125-b544-629d3432ff39 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:57.278433 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-fe1dd206-e559-4125-b544-629d3432ff39 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1504 microversion: 2.1 time: 0.250406 Aug 24 19:33:57.281820 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 389/756] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:57 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1504 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:57.287100 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-a6774d5b-8330-4237-91d1-59a2ba6f3251 req-4339802c-0c3b-433c-9fc1-796127b4bcb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff70d818-92c2-45bf-b298-96a45eb576a3", "name": "network-vif-plugged", "status": "completed", "tag": "9eae3e9d-b91a-4a71-8862-9ab8e3b42579"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:33:57.288700 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:33:57.288700 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:33:57.295605 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-a6774d5b-8330-4237-91d1-59a2ba6f3251 req-4339802c-0c3b-433c-9fc1-796127b4bcb5 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:57.296304 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-a6774d5b-8330-4237-91d1-59a2ba6f3251 req-4339802c-0c3b-433c-9fc1-796127b4bcb5 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:57.297379 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4bbf9325-bb31-47f5-9aad-46dfde62e0b6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:57.310665 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4bbf9325-bb31-47f5-9aad-46dfde62e0b6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:57.320672 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4bbf9325-bb31-47f5-9aad-46dfde62e0b6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:57.323757 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-a6774d5b-8330-4237-91d1-59a2ba6f3251 req-4339802c-0c3b-433c-9fc1-796127b4bcb5 service nova] Creating event network-vif-plugged:9eae3e9d-b91a-4a71-8862-9ab8e3b42579 for instance ff70d818-92c2-45bf-b298-96a45eb576a3 on hv-cinder-79819 Aug 24 19:33:57.323909 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4bbf9325-bb31-47f5-9aad-46dfde62e0b6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.281897 Aug 24 19:33:57.330009 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-a6774d5b-8330-4237-91d1-59a2ba6f3251 req-4339802c-0c3b-433c-9fc1-796127b4bcb5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046648 Aug 24 19:33:57.330204 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 368/757] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:57 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:33:57.344587 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 390/758] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:33:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:33:57.347003 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-42eddf0c-c30f-4498-b18b-7c06abd5ee0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:57.347712 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-42eddf0c-c30f-4498-b18b-7c06abd5ee0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:57.354545 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42eddf0c-c30f-4498-b18b-7c06abd5ee0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:57.355146 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42eddf0c-c30f-4498-b18b-7c06abd5ee0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:57.356230 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42eddf0c-c30f-4498-b18b-7c06abd5ee0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:57.356491 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-42eddf0c-c30f-4498-b18b-7c06abd5ee0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:57.549856 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-42eddf0c-c30f-4498-b18b-7c06abd5ee0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:57.563396 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-42eddf0c-c30f-4498-b18b-7c06abd5ee0e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.232086 Aug 24 19:33:57.569141 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 369/759] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:57 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:57.988837 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c6e22209-0dfa-4faf-bfdd-afaab7bd1d34 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:57.989558 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c6e22209-0dfa-4faf-bfdd-afaab7bd1d34 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:57.995784 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c6e22209-0dfa-4faf-bfdd-afaab7bd1d34 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:57.997868 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c6e22209-0dfa-4faf-bfdd-afaab7bd1d34 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:57.997868 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c6e22209-0dfa-4faf-bfdd-afaab7bd1d34 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:57.998232 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c6e22209-0dfa-4faf-bfdd-afaab7bd1d34 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:58.018773 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f3c0a00d-94dd-429c-a578-e2b2c604225c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:58.019452 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f3c0a00d-94dd-429c-a578-e2b2c604225c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:58.025584 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f3c0a00d-94dd-429c-a578-e2b2c604225c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:58.026538 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f3c0a00d-94dd-429c-a578-e2b2c604225c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:58.026775 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f3c0a00d-94dd-429c-a578-e2b2c604225c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:58.027367 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f3c0a00d-94dd-429c-a578-e2b2c604225c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:58.211618 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c6e22209-0dfa-4faf-bfdd-afaab7bd1d34 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:58.217124 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f3c0a00d-94dd-429c-a578-e2b2c604225c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:58.220029 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c6e22209-0dfa-4faf-bfdd-afaab7bd1d34 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.235162 Aug 24 19:33:58.220905 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 391/760] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:57 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:58.227415 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f3c0a00d-94dd-429c-a578-e2b2c604225c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.212344 Aug 24 19:33:58.227994 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 370/761] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:58 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:33:58.297368 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f0365ba7-2819-45b3-8972-5f883060a1ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:58.297997 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f0365ba7-2819-45b3-8972-5f883060a1ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:58.304557 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0365ba7-2819-45b3-8972-5f883060a1ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:58.305001 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0365ba7-2819-45b3-8972-5f883060a1ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:58.305802 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0365ba7-2819-45b3-8972-5f883060a1ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:58.306266 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0365ba7-2819-45b3-8972-5f883060a1ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:58.344247 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a7c68e72-ede6-4a11-a069-f87da9275f25 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:58.345245 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a7c68e72-ede6-4a11-a069-f87da9275f25 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:58.351204 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a7c68e72-ede6-4a11-a069-f87da9275f25 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:58.351652 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a7c68e72-ede6-4a11-a069-f87da9275f25 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:58.352658 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a7c68e72-ede6-4a11-a069-f87da9275f25 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:58.353254 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a7c68e72-ede6-4a11-a069-f87da9275f25 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:58.576381 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f0365ba7-2819-45b3-8972-5f883060a1ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:58.586046 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f0365ba7-2819-45b3-8972-5f883060a1ff tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1504 microversion: 2.1 time: 0.293298 Aug 24 19:33:58.586828 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 392/762] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:58 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:58.588221 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a7c68e72-ede6-4a11-a069-f87da9275f25 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:58.593454 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6002935a-bb71-411e-b2b7-c1870af619ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:58.599183 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6002935a-bb71-411e-b2b7-c1870af619ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:58.599837 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a7c68e72-ede6-4a11-a069-f87da9275f25 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:58.601364 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a7c68e72-ede6-4a11-a069-f87da9275f25 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:58.601515 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6002935a-bb71-411e-b2b7-c1870af619ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:58.601809 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6002935a-bb71-411e-b2b7-c1870af619ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:58.602503 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a7c68e72-ede6-4a11-a069-f87da9275f25 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.262822 Aug 24 19:33:58.602646 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6002935a-bb71-411e-b2b7-c1870af619ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:58.603219 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 371/763] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:58 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:33:58.603350 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6002935a-bb71-411e-b2b7-c1870af619ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:58.756161 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6002935a-bb71-411e-b2b7-c1870af619ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:58.766250 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6002935a-bb71-411e-b2b7-c1870af619ac tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.175953 Aug 24 19:33:58.766250 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 393/764] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:58 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:59.238085 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-50c71cda-af87-4738-bab9-eb530fd99708 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:59.238684 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-50c71cda-af87-4738-bab9-eb530fd99708 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:59.247350 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-50c71cda-af87-4738-bab9-eb530fd99708 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:59.247867 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-50c71cda-af87-4738-bab9-eb530fd99708 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:59.248710 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-50c71cda-af87-4738-bab9-eb530fd99708 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:59.249134 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-50c71cda-af87-4738-bab9-eb530fd99708 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:59.249856 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4b95ca3c-3007-4458-8e1b-62c9065a8899 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:59.250608 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4b95ca3c-3007-4458-8e1b-62c9065a8899 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:59.257477 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b95ca3c-3007-4458-8e1b-62c9065a8899 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:59.258261 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b95ca3c-3007-4458-8e1b-62c9065a8899 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:59.259305 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b95ca3c-3007-4458-8e1b-62c9065a8899 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:59.259979 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b95ca3c-3007-4458-8e1b-62c9065a8899 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:59.446768 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-50c71cda-af87-4738-bab9-eb530fd99708 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:59.454698 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-50c71cda-af87-4738-bab9-eb530fd99708 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.220254 Aug 24 19:33:59.455278 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 372/765] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:59 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:59.468673 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4b95ca3c-3007-4458-8e1b-62c9065a8899 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:59.473227 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4b95ca3c-3007-4458-8e1b-62c9065a8899 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.228843 Aug 24 19:33:59.473793 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 394/766] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:59 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:59.602885 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-46bafb1f-6f4e-4ca6-af03-bf0a8bf6e7c6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:59.603485 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-46bafb1f-6f4e-4ca6-af03-bf0a8bf6e7c6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:59.609621 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46bafb1f-6f4e-4ca6-af03-bf0a8bf6e7c6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:59.610120 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46bafb1f-6f4e-4ca6-af03-bf0a8bf6e7c6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:59.610894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46bafb1f-6f4e-4ca6-af03-bf0a8bf6e7c6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:59.611324 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46bafb1f-6f4e-4ca6-af03-bf0a8bf6e7c6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:59.621241 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8dac9837-1e16-44b2-9e2a-7c62e378b2f8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:59.622122 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8dac9837-1e16-44b2-9e2a-7c62e378b2f8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:59.628625 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8dac9837-1e16-44b2-9e2a-7c62e378b2f8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:59.634230 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8dac9837-1e16-44b2-9e2a-7c62e378b2f8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:59.634230 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8dac9837-1e16-44b2-9e2a-7c62e378b2f8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:59.634230 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8dac9837-1e16-44b2-9e2a-7c62e378b2f8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:59.834743 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-46bafb1f-6f4e-4ca6-af03-bf0a8bf6e7c6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:59.838142 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8dac9837-1e16-44b2-9e2a-7c62e378b2f8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:59.847537 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-46bafb1f-6f4e-4ca6-af03-bf0a8bf6e7c6 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1504 microversion: 2.1 time: 0.248236 Aug 24 19:33:59.847711 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8dac9837-1e16-44b2-9e2a-7c62e378b2f8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:59.849019 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 373/767] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:59 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:33:59.849217 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8dac9837-1e16-44b2-9e2a-7c62e378b2f8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:33:59.850377 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8dac9837-1e16-44b2-9e2a-7c62e378b2f8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.232991 Aug 24 19:33:59.854946 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-899fd20a-5758-47b1-87d5-424396cff8d9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:33:59.855856 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-899fd20a-5758-47b1-87d5-424396cff8d9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:33:59.862257 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 395/768] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:33:59 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:33:59.865936 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-899fd20a-5758-47b1-87d5-424396cff8d9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:59.866390 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-899fd20a-5758-47b1-87d5-424396cff8d9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:33:59.867185 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-899fd20a-5758-47b1-87d5-424396cff8d9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:33:59.867624 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-899fd20a-5758-47b1-87d5-424396cff8d9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:00.000988 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-899fd20a-5758-47b1-87d5-424396cff8d9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:00.009595 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-899fd20a-5758-47b1-87d5-424396cff8d9 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.158945 Aug 24 19:34:00.019881 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 374/769] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:33:59 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:00.471332 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c2b87857-fbbc-4d8c-b57e-a9bc6c2a4d5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:00.471937 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c2b87857-fbbc-4d8c-b57e-a9bc6c2a4d5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:00.478107 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c2b87857-fbbc-4d8c-b57e-a9bc6c2a4d5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:00.478515 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c2b87857-fbbc-4d8c-b57e-a9bc6c2a4d5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:00.482985 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c2b87857-fbbc-4d8c-b57e-a9bc6c2a4d5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:00.482985 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c2b87857-fbbc-4d8c-b57e-a9bc6c2a4d5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:00.491037 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2c97c5cb-5778-45f7-95c3-1f2eb00c5639 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:00.491908 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2c97c5cb-5778-45f7-95c3-1f2eb00c5639 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:00.511630 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2c97c5cb-5778-45f7-95c3-1f2eb00c5639 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:00.511630 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2c97c5cb-5778-45f7-95c3-1f2eb00c5639 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:00.511630 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2c97c5cb-5778-45f7-95c3-1f2eb00c5639 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:00.511630 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2c97c5cb-5778-45f7-95c3-1f2eb00c5639 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:00.700087 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-2c97c5cb-5778-45f7-95c3-1f2eb00c5639 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:00.709356 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2c97c5cb-5778-45f7-95c3-1f2eb00c5639 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.221975 Aug 24 19:34:00.716419 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 375/770] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:00 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:34:00.722028 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c2b87857-fbbc-4d8c-b57e-a9bc6c2a4d5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:00.729523 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c2b87857-fbbc-4d8c-b57e-a9bc6c2a4d5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.262134 Aug 24 19:34:00.742876 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 396/771] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:00 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:34:00.865442 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e886e119-45e9-4849-b1a4-ad4c24395c59 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:00.866045 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e886e119-45e9-4849-b1a4-ad4c24395c59 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:00.869346 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-33af3c86-136b-4b5d-85ca-f6550ed69e0e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:00.870010 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-33af3c86-136b-4b5d-85ca-f6550ed69e0e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:00.872447 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e886e119-45e9-4849-b1a4-ad4c24395c59 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:00.878452 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e886e119-45e9-4849-b1a4-ad4c24395c59 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:00.878452 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e886e119-45e9-4849-b1a4-ad4c24395c59 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:00.878452 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e886e119-45e9-4849-b1a4-ad4c24395c59 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:00.880879 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-33af3c86-136b-4b5d-85ca-f6550ed69e0e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:00.881323 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-33af3c86-136b-4b5d-85ca-f6550ed69e0e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:00.882095 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-33af3c86-136b-4b5d-85ca-f6550ed69e0e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:00.882520 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-33af3c86-136b-4b5d-85ca-f6550ed69e0e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:01.089477 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e886e119-45e9-4849-b1a4-ad4c24395c59 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:01.096117 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-33af3c86-136b-4b5d-85ca-f6550ed69e0e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:01.098816 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e886e119-45e9-4849-b1a4-ad4c24395c59 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1504 microversion: 2.1 time: 0.237060 Aug 24 19:34:01.100507 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 376/772] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:00 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:01.107511 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-33af3c86-136b-4b5d-85ca-f6550ed69e0e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:01.109559 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-33af3c86-136b-4b5d-85ca-f6550ed69e0e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:01.109725 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0d1702bc-9fcb-4089-ba92-d1848466313e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:01.110386 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0d1702bc-9fcb-4089-ba92-d1848466313e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:01.110874 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-33af3c86-136b-4b5d-85ca-f6550ed69e0e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.245437 Aug 24 19:34:01.121418 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0d1702bc-9fcb-4089-ba92-d1848466313e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:01.121750 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 397/773] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:00 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:34:01.122198 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0d1702bc-9fcb-4089-ba92-d1848466313e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:01.123028 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0d1702bc-9fcb-4089-ba92-d1848466313e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:01.123506 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0d1702bc-9fcb-4089-ba92-d1848466313e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:01.262023 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0d1702bc-9fcb-4089-ba92-d1848466313e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:01.270550 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0d1702bc-9fcb-4089-ba92-d1848466313e tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.169936 Aug 24 19:34:01.272359 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 377/774] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:01 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:01.727204 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-074c1fff-5e47-47d9-ae87-5adc6b37cb31 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:01.727858 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-074c1fff-5e47-47d9-ae87-5adc6b37cb31 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:01.737281 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-074c1fff-5e47-47d9-ae87-5adc6b37cb31 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:01.737729 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-074c1fff-5e47-47d9-ae87-5adc6b37cb31 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:01.738522 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-074c1fff-5e47-47d9-ae87-5adc6b37cb31 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:01.738951 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-074c1fff-5e47-47d9-ae87-5adc6b37cb31 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:01.750541 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-49145694-c8e0-4ac5-81cb-2c9bf14235ea tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:01.752067 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-49145694-c8e0-4ac5-81cb-2c9bf14235ea tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:01.763751 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-49145694-c8e0-4ac5-81cb-2c9bf14235ea tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:01.764942 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-49145694-c8e0-4ac5-81cb-2c9bf14235ea tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:01.765683 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-49145694-c8e0-4ac5-81cb-2c9bf14235ea tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:01.766128 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-49145694-c8e0-4ac5-81cb-2c9bf14235ea tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:02.028619 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-074c1fff-5e47-47d9-ae87-5adc6b37cb31 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:02.037971 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-49145694-c8e0-4ac5-81cb-2c9bf14235ea tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:02.040901 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-074c1fff-5e47-47d9-ae87-5adc6b37cb31 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.317551 Aug 24 19:34:02.042631 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 398/775] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:01 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:02.045913 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-49145694-c8e0-4ac5-81cb-2c9bf14235ea tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.299852 Aug 24 19:34:02.046651 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 378/776] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:01 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:34:02.117125 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1e8ac5f9-61bc-4c3f-b972-6d5ac78cce50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:02.117853 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1e8ac5f9-61bc-4c3f-b972-6d5ac78cce50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:02.124616 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1e8ac5f9-61bc-4c3f-b972-6d5ac78cce50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:02.130040 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-49d74351-ab10-4047-a6be-3db39175f34d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:02.130728 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-49d74351-ab10-4047-a6be-3db39175f34d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:02.133531 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1e8ac5f9-61bc-4c3f-b972-6d5ac78cce50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:02.136423 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1e8ac5f9-61bc-4c3f-b972-6d5ac78cce50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:02.137569 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1e8ac5f9-61bc-4c3f-b972-6d5ac78cce50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:02.137989 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-49d74351-ab10-4047-a6be-3db39175f34d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:02.138448 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-49d74351-ab10-4047-a6be-3db39175f34d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:02.139238 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-49d74351-ab10-4047-a6be-3db39175f34d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:02.139670 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-49d74351-ab10-4047-a6be-3db39175f34d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:02.345599 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1e8ac5f9-61bc-4c3f-b972-6d5ac78cce50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:02.348987 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-49d74351-ab10-4047-a6be-3db39175f34d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:02.353630 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1e8ac5f9-61bc-4c3f-b972-6d5ac78cce50 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1504 microversion: 2.1 time: 0.240027 Aug 24 19:34:02.363892 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-49d74351-ab10-4047-a6be-3db39175f34d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:02.363892 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-49d74351-ab10-4047-a6be-3db39175f34d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:02.363892 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-49d74351-ab10-4047-a6be-3db39175f34d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.235281 Aug 24 19:34:02.364313 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 379/777] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:02 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:02.368126 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 399/778] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:02 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:02.368503 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ea1834e9-0016-4888-a58f-b95c2331344c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:02.369773 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ea1834e9-0016-4888-a58f-b95c2331344c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:02.376855 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ea1834e9-0016-4888-a58f-b95c2331344c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:02.382120 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ea1834e9-0016-4888-a58f-b95c2331344c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:02.382120 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ea1834e9-0016-4888-a58f-b95c2331344c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:02.382120 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ea1834e9-0016-4888-a58f-b95c2331344c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:02.506013 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ea1834e9-0016-4888-a58f-b95c2331344c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:02.514197 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ea1834e9-0016-4888-a58f-b95c2331344c tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.149944 Aug 24 19:34:02.514715 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 380/779] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:02 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:03.063907 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0e35bb3f-fa8f-494c-bde6-26d39e118ae7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:03.064534 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0e35bb3f-fa8f-494c-bde6-26d39e118ae7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:03.070804 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0e35bb3f-fa8f-494c-bde6-26d39e118ae7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:03.071697 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0e35bb3f-fa8f-494c-bde6-26d39e118ae7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:03.072517 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0e35bb3f-fa8f-494c-bde6-26d39e118ae7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:03.073135 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0e35bb3f-fa8f-494c-bde6-26d39e118ae7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:03.076477 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-cacade53-a35d-4919-a2e0-24922ca781ab tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:03.077158 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-cacade53-a35d-4919-a2e0-24922ca781ab tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:03.083328 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cacade53-a35d-4919-a2e0-24922ca781ab tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:03.083835 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cacade53-a35d-4919-a2e0-24922ca781ab tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:03.084667 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cacade53-a35d-4919-a2e0-24922ca781ab tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:03.085107 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cacade53-a35d-4919-a2e0-24922ca781ab tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:03.293499 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-cacade53-a35d-4919-a2e0-24922ca781ab tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:03.298331 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0e35bb3f-fa8f-494c-bde6-26d39e118ae7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:03.302513 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-cacade53-a35d-4919-a2e0-24922ca781ab tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.229958 Aug 24 19:34:03.304366 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 381/780] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:03 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:34:03.306841 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0e35bb3f-fa8f-494c-bde6-26d39e118ae7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.246766 Aug 24 19:34:03.317074 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 400/781] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:03 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:03.371126 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-28a4028f-fb56-45f6-84df-eb6f82927598 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:03.371727 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-28a4028f-fb56-45f6-84df-eb6f82927598 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:03.377829 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-28a4028f-fb56-45f6-84df-eb6f82927598 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:03.378271 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-28a4028f-fb56-45f6-84df-eb6f82927598 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:03.379043 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-28a4028f-fb56-45f6-84df-eb6f82927598 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:03.379471 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-28a4028f-fb56-45f6-84df-eb6f82927598 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:03.380887 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-301d8e19-2f65-4adc-b7e0-548569506333 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:03.381492 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-301d8e19-2f65-4adc-b7e0-548569506333 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:03.388176 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-301d8e19-2f65-4adc-b7e0-548569506333 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:03.388950 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-301d8e19-2f65-4adc-b7e0-548569506333 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:03.389943 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-301d8e19-2f65-4adc-b7e0-548569506333 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:03.390574 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-301d8e19-2f65-4adc-b7e0-548569506333 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:03.568510 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-28a4028f-fb56-45f6-84df-eb6f82927598 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:03.575974 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-301d8e19-2f65-4adc-b7e0-548569506333 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:03.576594 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-28a4028f-fb56-45f6-84df-eb6f82927598 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1504 microversion: 2.1 time: 0.209169 Aug 24 19:34:03.577260 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 382/782] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:03 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:03.581951 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-60d837b1-5020-40ed-a150-ac1be1a201f2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:03.582589 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-60d837b1-5020-40ed-a150-ac1be1a201f2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:03.585224 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-301d8e19-2f65-4adc-b7e0-548569506333 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:03.586700 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-301d8e19-2f65-4adc-b7e0-548569506333 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:03.587892 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-301d8e19-2f65-4adc-b7e0-548569506333 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.211538 Aug 24 19:34:03.588446 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 401/783] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:03 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:34:03.588669 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-60d837b1-5020-40ed-a150-ac1be1a201f2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:03.589117 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-60d837b1-5020-40ed-a150-ac1be1a201f2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:03.590436 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-60d837b1-5020-40ed-a150-ac1be1a201f2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:03.590868 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-60d837b1-5020-40ed-a150-ac1be1a201f2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:03.719050 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-60d837b1-5020-40ed-a150-ac1be1a201f2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:03.743353 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-60d837b1-5020-40ed-a150-ac1be1a201f2 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.164904 Aug 24 19:34:03.744546 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 383/784] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:03 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:04.318618 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ff13ff89-707c-4757-a966-c869b4ce0957 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:04.319243 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ff13ff89-707c-4757-a966-c869b4ce0957 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:04.325247 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ff13ff89-707c-4757-a966-c869b4ce0957 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:04.325703 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ff13ff89-707c-4757-a966-c869b4ce0957 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:04.326469 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ff13ff89-707c-4757-a966-c869b4ce0957 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:04.326931 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ff13ff89-707c-4757-a966-c869b4ce0957 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:04.333419 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-08ae75db-0c24-4906-a0b7-120bf40a43e5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:04.334036 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-08ae75db-0c24-4906-a0b7-120bf40a43e5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:04.340394 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-08ae75db-0c24-4906-a0b7-120bf40a43e5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:04.340843 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-08ae75db-0c24-4906-a0b7-120bf40a43e5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:04.341616 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-08ae75db-0c24-4906-a0b7-120bf40a43e5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:04.342047 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-08ae75db-0c24-4906-a0b7-120bf40a43e5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:04.514404 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ff13ff89-707c-4757-a966-c869b4ce0957 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:04.521869 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ff13ff89-707c-4757-a966-c869b4ce0957 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1676 microversion: 2.1 time: 0.206831 Aug 24 19:34:04.522452 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 402/785] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:04 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1676 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:04.527523 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-08ae75db-0c24-4906-a0b7-120bf40a43e5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:04.535199 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-08ae75db-0c24-4906-a0b7-120bf40a43e5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.205401 Aug 24 19:34:04.535752 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 384/786] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:04 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:34:04.594375 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-026a370f-7385-40f3-ab4e-89992ebb8610 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:04.594919 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-026a370f-7385-40f3-ab4e-89992ebb8610 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:04.600690 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-026a370f-7385-40f3-ab4e-89992ebb8610 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:04.601199 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-026a370f-7385-40f3-ab4e-89992ebb8610 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:04.602298 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-026a370f-7385-40f3-ab4e-89992ebb8610 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:04.602738 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-026a370f-7385-40f3-ab4e-89992ebb8610 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:04.606947 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-dd7274b2-804a-4590-bc1d-b4671600c64c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:04.607551 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-dd7274b2-804a-4590-bc1d-b4671600c64c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:04.613519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dd7274b2-804a-4590-bc1d-b4671600c64c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:04.616675 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dd7274b2-804a-4590-bc1d-b4671600c64c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:04.616675 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dd7274b2-804a-4590-bc1d-b4671600c64c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:04.616675 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dd7274b2-804a-4590-bc1d-b4671600c64c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:04.801612 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-026a370f-7385-40f3-ab4e-89992ebb8610 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:04.806992 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-dd7274b2-804a-4590-bc1d-b4671600c64c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:04.809307 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-026a370f-7385-40f3-ab4e-89992ebb8610 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1504 microversion: 2.1 time: 0.218767 Aug 24 19:34:04.809886 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 403/787] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:04 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:04.814156 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4b1483ba-2d37-40d5-bfe5-4fddd8924be6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:04.814796 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4b1483ba-2d37-40d5-bfe5-4fddd8924be6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:04.824015 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b1483ba-2d37-40d5-bfe5-4fddd8924be6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:04.824527 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b1483ba-2d37-40d5-bfe5-4fddd8924be6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:04.825313 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b1483ba-2d37-40d5-bfe5-4fddd8924be6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:04.825862 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b1483ba-2d37-40d5-bfe5-4fddd8924be6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:04.829274 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-dd7274b2-804a-4590-bc1d-b4671600c64c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:04.830756 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-dd7274b2-804a-4590-bc1d-b4671600c64c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:04.831938 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-dd7274b2-804a-4590-bc1d-b4671600c64c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.229181 Aug 24 19:34:04.832748 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 385/788] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:04 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:34:04.953407 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4b1483ba-2d37-40d5-bfe5-4fddd8924be6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:04.960642 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4b1483ba-2d37-40d5-bfe5-4fddd8924be6 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1520 microversion: 2.1 time: 0.149786 Aug 24 19:34:04.961212 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 404/789] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:04 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:05.538883 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-28b71168-b57e-46d2-9b96-2cb71d493aa6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:05.539487 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-28b71168-b57e-46d2-9b96-2cb71d493aa6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:05.545243 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-28b71168-b57e-46d2-9b96-2cb71d493aa6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:05.545687 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-28b71168-b57e-46d2-9b96-2cb71d493aa6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:05.546444 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-28b71168-b57e-46d2-9b96-2cb71d493aa6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:05.546897 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-28b71168-b57e-46d2-9b96-2cb71d493aa6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:05.552721 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1fa47e73-1b97-4660-a43f-f92cc6a35306 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:05.553770 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1fa47e73-1b97-4660-a43f-f92cc6a35306 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:05.559958 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1fa47e73-1b97-4660-a43f-f92cc6a35306 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:05.565233 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1fa47e73-1b97-4660-a43f-f92cc6a35306 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:05.565233 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1fa47e73-1b97-4660-a43f-f92cc6a35306 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:05.565233 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1fa47e73-1b97-4660-a43f-f92cc6a35306 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:05.793119 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-28b71168-b57e-46d2-9b96-2cb71d493aa6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:05.802231 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-28b71168-b57e-46d2-9b96-2cb71d493aa6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1653 microversion: 2.1 time: 0.266900 Aug 24 19:34:05.803076 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 386/790] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:05 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1653 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:34:05.812402 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1fa47e73-1b97-4660-a43f-f92cc6a35306 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:05.812705 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-2050655d-0d1d-4b76-b291-12ffddeccd77 req-e9841f1b-7b6d-4672-bb24-876585aa0ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "649b4ff1-abbd-4ccb-8b5a-9ba24f560372", "name": "network-vif-deleted", "tag": "c7975fe5-d0d9-4c7d-a3b8-f11f1f55a395"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:34:05.812705 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:34:05.812705 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:34:05.818589 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-2050655d-0d1d-4b76-b291-12ffddeccd77 req-e9841f1b-7b6d-4672-bb24-876585aa0ece service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:05.818970 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1fa47e73-1b97-4660-a43f-f92cc6a35306 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1259 microversion: 2.1 time: 0.270054 Aug 24 19:34:05.819089 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-2050655d-0d1d-4b76-b291-12ffddeccd77 req-e9841f1b-7b6d-4672-bb24-876585aa0ece service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:05.819544 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 405/791] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:05 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1259 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:34:05.824757 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a3fd14df-90b4-4586-b56d-a7112e71da67 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:34:05.831193 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a3fd14df-90b4-4586-b56d-a7112e71da67 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:05.831193 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a3fd14df-90b4-4586-b56d-a7112e71da67 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:05.833593 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-2050655d-0d1d-4b76-b291-12ffddeccd77 req-e9841f1b-7b6d-4672-bb24-876585aa0ece service nova] Creating event network-vif-deleted:c7975fe5-d0d9-4c7d-a3b8-f11f1f55a395 for instance 649b4ff1-abbd-4ccb-8b5a-9ba24f560372 on hv-cinder-79819 Aug 24 19:34:05.838652 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-2050655d-0d1d-4b76-b291-12ffddeccd77 req-e9841f1b-7b6d-4672-bb24-876585aa0ece service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031851 Aug 24 19:34:05.839869 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 387/792] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:34:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:34:05.847445 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-626b948d-7e47-482b-b1c7-6b6fda10733b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:05.848181 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-626b948d-7e47-482b-b1c7-6b6fda10733b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:05.854448 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a3fd14df-90b4-4586-b56d-a7112e71da67 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Going to try to start instance {{(pid=108907) start /opt/stack/nova/nova/compute/api.py:2637}} Aug 24 19:34:05.854640 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-626b948d-7e47-482b-b1c7-6b6fda10733b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:05.855126 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-626b948d-7e47-482b-b1c7-6b6fda10733b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:05.855842 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-626b948d-7e47-482b-b1c7-6b6fda10733b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:05.856356 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-626b948d-7e47-482b-b1c7-6b6fda10733b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:05.990993 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-626b948d-7e47-482b-b1c7-6b6fda10733b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:06.007416 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-626b948d-7e47-482b-b1c7-6b6fda10733b tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1504 microversion: 2.1 time: 0.163653 Aug 24 19:34:06.008312 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 388/793] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:05 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:06.013236 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-92ec6c0c-89c3-4fed-bdf4-a1643b189c69 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:06.014033 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-92ec6c0c-89c3-4fed-bdf4-a1643b189c69 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:06.020294 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-92ec6c0c-89c3-4fed-bdf4-a1643b189c69 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:06.020755 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-92ec6c0c-89c3-4fed-bdf4-a1643b189c69 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:06.038483 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-92ec6c0c-89c3-4fed-bdf4-a1643b189c69 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:06.038483 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-92ec6c0c-89c3-4fed-bdf4-a1643b189c69 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:06.152655 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-92ec6c0c-89c3-4fed-bdf4-a1643b189c69 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:06.161514 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-92ec6c0c-89c3-4fed-bdf4-a1643b189c69 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:06.162993 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-92ec6c0c-89c3-4fed-bdf4-a1643b189c69 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:06.164485 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-92ec6c0c-89c3-4fed-bdf4-a1643b189c69 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.155018 Aug 24 19:34:06.164740 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 389/794] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:06 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:06.169618 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4fa00a7a-510c-44b2-8168-120d9f9bcd2b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:06.170216 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4fa00a7a-510c-44b2-8168-120d9f9bcd2b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:06.176007 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4fa00a7a-510c-44b2-8168-120d9f9bcd2b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:06.176355 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4fa00a7a-510c-44b2-8168-120d9f9bcd2b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:06.177896 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4fa00a7a-510c-44b2-8168-120d9f9bcd2b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:06.177896 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4fa00a7a-510c-44b2-8168-120d9f9bcd2b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:06.211455 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4fa00a7a-510c-44b2-8168-120d9f9bcd2b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:06.211919 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4fa00a7a-510c-44b2-8168-120d9f9bcd2b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:06.212406 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.objects.instance [None req-4fa00a7a-510c-44b2-8168-120d9f9bcd2b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lazy-loading 'fault' on Instance uuid 649b4ff1-abbd-4ccb-8b5a-9ba24f560372 {{(pid=108908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:34:06.217990 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a3fd14df-90b4-4586-b56d-a7112e71da67 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action" status: 202 len: 0 microversion: 2.1 time: 0.397040 Aug 24 19:34:06.222284 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 406/795] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:34:05 2021] POST /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:34:06.229647 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f58f2301-4d3b-4d67-bc77-1b72b789bd32 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:06.230860 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f58f2301-4d3b-4d67-bc77-1b72b789bd32 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:06.237022 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f58f2301-4d3b-4d67-bc77-1b72b789bd32 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:06.237460 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f58f2301-4d3b-4d67-bc77-1b72b789bd32 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:06.238241 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f58f2301-4d3b-4d67-bc77-1b72b789bd32 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:06.238670 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f58f2301-4d3b-4d67-bc77-1b72b789bd32 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:06.257179 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4fa00a7a-510c-44b2-8168-120d9f9bcd2b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fb0f69d69264e3394a61616951270bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12f52cbd047b400a8376723f14c37c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:06.266327 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4fa00a7a-510c-44b2-8168-120d9f9bcd2b tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 200 len: 1311 microversion: 2.1 time: 0.100524 Aug 24 19:34:06.267098 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 390/796] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:06 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:06.377872 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f58f2301-4d3b-4d67-bc77-1b72b789bd32 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:06.386995 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f58f2301-4d3b-4d67-bc77-1b72b789bd32 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1662 microversion: 2.1 time: 0.161313 Aug 24 19:34:06.389830 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 407/797] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:06 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1662 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:06.836705 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0a18bac7-c813-476a-9505-9478770859b2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:06.837308 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0a18bac7-c813-476a-9505-9478770859b2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:06.843922 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0a18bac7-c813-476a-9505-9478770859b2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:06.846835 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0a18bac7-c813-476a-9505-9478770859b2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:06.846835 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0a18bac7-c813-476a-9505-9478770859b2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:06.846835 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0a18bac7-c813-476a-9505-9478770859b2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:07.024512 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-69eef757-4501-447a-a7ac-e02578e84910 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:07.025899 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-69eef757-4501-447a-a7ac-e02578e84910 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:07.036749 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-69eef757-4501-447a-a7ac-e02578e84910 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:07.037521 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-69eef757-4501-447a-a7ac-e02578e84910 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:07.038707 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-69eef757-4501-447a-a7ac-e02578e84910 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:07.039302 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-69eef757-4501-447a-a7ac-e02578e84910 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:07.322343 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0a18bac7-c813-476a-9505-9478770859b2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:07.340112 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0a18bac7-c813-476a-9505-9478770859b2 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1443 microversion: 2.1 time: 0.507250 Aug 24 19:34:07.341297 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 391/798] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:06 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1443 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:34:07.360610 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-65232218-0970-47f8-9460-ab89e286174a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:07.361618 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-65232218-0970-47f8-9460-ab89e286174a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:07.372307 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65232218-0970-47f8-9460-ab89e286174a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:07.373067 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65232218-0970-47f8-9460-ab89e286174a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:07.374585 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65232218-0970-47f8-9460-ab89e286174a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:07.375179 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65232218-0970-47f8-9460-ab89e286174a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:07.400686 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-69eef757-4501-447a-a7ac-e02578e84910 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:07.408086 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-69eef757-4501-447a-a7ac-e02578e84910 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1504 microversion: 2.1 time: 0.387614 Aug 24 19:34:07.408688 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 408/799] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:07 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1504 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:34:07.420002 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-20d494ab-f686-4ab6-a989-00d385d29746 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:07.420639 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-20d494ab-f686-4ab6-a989-00d385d29746 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] [instance: 649b4ff1-abbd-4ccb-8b5a-9ba24f560372] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:07.428766 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-20d494ab-f686-4ab6-a989-00d385d29746 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:07.429218 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-20d494ab-f686-4ab6-a989-00d385d29746 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:07.429995 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-20d494ab-f686-4ab6-a989-00d385d29746 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:07.430675 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-20d494ab-f686-4ab6-a989-00d385d29746 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:07.450743 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-20d494ab-f686-4ab6-a989-00d385d29746 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] HTTP exception thrown: Instance 649b4ff1-abbd-4ccb-8b5a-9ba24f560372 could not be found. Aug 24 19:34:07.451490 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-20d494ab-f686-4ab6-a989-00d385d29746 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] Returning 404 to user: Instance 649b4ff1-abbd-4ccb-8b5a-9ba24f560372 could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:34:07.452687 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-20d494ab-f686-4ab6-a989-00d385d29746 tempest-ServerRescueNegativeTestJSON-1027739485 tempest-ServerRescueNegativeTestJSON-1027739485-project] 10.222.0.59 "GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372" status: 404 len: 111 microversion: 2.1 time: 0.038062 Aug 24 19:34:07.454316 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 409/800] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:07 2021] GET /compute/v2.1/servers/649b4ff1-abbd-4ccb-8b5a-9ba24f560372 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:34:07.460558 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-76385a42-89f9-4acd-b4d4-bdeed0fa76f7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:07.461520 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-76385a42-89f9-4acd-b4d4-bdeed0fa76f7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:07.467873 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-76385a42-89f9-4acd-b4d4-bdeed0fa76f7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:07.468447 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-76385a42-89f9-4acd-b4d4-bdeed0fa76f7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:07.469575 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-76385a42-89f9-4acd-b4d4-bdeed0fa76f7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:07.470073 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-76385a42-89f9-4acd-b4d4-bdeed0fa76f7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:07.637884 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-65232218-0970-47f8-9460-ab89e286174a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:07.646440 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-65232218-0970-47f8-9460-ab89e286174a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:07.648073 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-65232218-0970-47f8-9460-ab89e286174a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:07.649316 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-65232218-0970-47f8-9460-ab89e286174a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.295136 Aug 24 19:34:07.649939 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 392/801] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:07 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:07.659443 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-303deedb-c8e0-42a1-a414-79f35b40a16a req-c5df46ad-b90f-487e-b6c7-6cccb60f96b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71966c1-f9be-4c1c-b1b3-0b9b87351800", "name": "network-vif-deleted", "tag": "22b31ca4-ca4d-4def-b031-033feec3b7b6"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:34:07.661504 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:34:07.661504 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:34:07.668306 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-303deedb-c8e0-42a1-a414-79f35b40a16a req-c5df46ad-b90f-487e-b6c7-6cccb60f96b7 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:07.668764 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-303deedb-c8e0-42a1-a414-79f35b40a16a req-c5df46ad-b90f-487e-b6c7-6cccb60f96b7 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:07.680237 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-303deedb-c8e0-42a1-a414-79f35b40a16a req-c5df46ad-b90f-487e-b6c7-6cccb60f96b7 service nova] Creating event network-vif-deleted:22b31ca4-ca4d-4def-b031-033feec3b7b6 for instance b71966c1-f9be-4c1c-b1b3-0b9b87351800 on hv-cinder-79819 Aug 24 19:34:07.687407 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-303deedb-c8e0-42a1-a414-79f35b40a16a req-c5df46ad-b90f-487e-b6c7-6cccb60f96b7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036104 Aug 24 19:34:07.688013 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 393/802] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:34:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:34:07.701494 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0e89e3c9-5356-4439-94a5-acaa42b16ef0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:07.702386 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0e89e3c9-5356-4439-94a5-acaa42b16ef0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:07.710476 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0e89e3c9-5356-4439-94a5-acaa42b16ef0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:07.711003 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0e89e3c9-5356-4439-94a5-acaa42b16ef0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:07.711987 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0e89e3c9-5356-4439-94a5-acaa42b16ef0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:07.713146 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0e89e3c9-5356-4439-94a5-acaa42b16ef0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:07.775600 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-76385a42-89f9-4acd-b4d4-bdeed0fa76f7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:07.784637 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-76385a42-89f9-4acd-b4d4-bdeed0fa76f7 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1443 microversion: 2.1 time: 0.328961 Aug 24 19:34:07.785258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 410/803] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:07 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1443 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:07.944970 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0e89e3c9-5356-4439-94a5-acaa42b16ef0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:07.951202 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0e89e3c9-5356-4439-94a5-acaa42b16ef0 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1662 microversion: 2.1 time: 0.257718 Aug 24 19:34:07.961257 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 394/804] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:07 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1662 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:08.425561 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e5b7ad83-0abb-4cdf-9217-467cac8aa03e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:08.426165 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e5b7ad83-0abb-4cdf-9217-467cac8aa03e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:08.432171 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5b7ad83-0abb-4cdf-9217-467cac8aa03e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:08.433174 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5b7ad83-0abb-4cdf-9217-467cac8aa03e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:08.434112 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5b7ad83-0abb-4cdf-9217-467cac8aa03e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:08.434536 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5b7ad83-0abb-4cdf-9217-467cac8aa03e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:08.466576 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5b7ad83-0abb-4cdf-9217-467cac8aa03e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:08.467025 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5b7ad83-0abb-4cdf-9217-467cac8aa03e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:08.467462 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-e5b7ad83-0abb-4cdf-9217-467cac8aa03e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lazy-loading 'fault' on Instance uuid b71966c1-f9be-4c1c-b1b3-0b9b87351800 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:34:08.513234 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e5b7ad83-0abb-4cdf-9217-467cac8aa03e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77c66020d31a4598995dcabb76ce4362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed4565c07554a2e8dd34da9c4f80956', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:08.520533 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e5b7ad83-0abb-4cdf-9217-467cac8aa03e tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 200 len: 1304 microversion: 2.1 time: 0.098504 Aug 24 19:34:08.521690 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 411/805] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:08 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:08.667748 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9b320f4b-594a-4801-ac21-59040a841cd6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:08.668391 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9b320f4b-594a-4801-ac21-59040a841cd6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:08.674136 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9b320f4b-594a-4801-ac21-59040a841cd6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:08.674581 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9b320f4b-594a-4801-ac21-59040a841cd6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:08.679816 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9b320f4b-594a-4801-ac21-59040a841cd6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:08.679816 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9b320f4b-594a-4801-ac21-59040a841cd6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:08.813291 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9b320f4b-594a-4801-ac21-59040a841cd6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:08.825872 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9b320f4b-594a-4801-ac21-59040a841cd6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:08.827627 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9b320f4b-594a-4801-ac21-59040a841cd6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:08.829125 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9b320f4b-594a-4801-ac21-59040a841cd6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.165165 Aug 24 19:34:08.829899 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 395/806] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:08 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:08.970584 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-82d4e52a-4d7f-4fdd-88c4-4b3e3b2296c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:08.971232 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-82d4e52a-4d7f-4fdd-88c4-4b3e3b2296c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:08.982693 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-82d4e52a-4d7f-4fdd-88c4-4b3e3b2296c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:08.983566 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-82d4e52a-4d7f-4fdd-88c4-4b3e3b2296c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:08.984389 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-82d4e52a-4d7f-4fdd-88c4-4b3e3b2296c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:08.984978 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-82d4e52a-4d7f-4fdd-88c4-4b3e3b2296c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:09.485202 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-82d4e52a-4d7f-4fdd-88c4-4b3e3b2296c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:09.493807 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-82d4e52a-4d7f-4fdd-88c4-4b3e3b2296c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1666 microversion: 2.1 time: 0.528224 Aug 24 19:34:09.494451 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 412/807] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:08 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1666 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:09.538241 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-46977d4e-34c1-4034-acb1-ac7f7b782f99 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:09.538848 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-46977d4e-34c1-4034-acb1-ac7f7b782f99 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] [instance: b71966c1-f9be-4c1c-b1b3-0b9b87351800] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:09.545928 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46977d4e-34c1-4034-acb1-ac7f7b782f99 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:09.547287 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46977d4e-34c1-4034-acb1-ac7f7b782f99 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:09.547287 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46977d4e-34c1-4034-acb1-ac7f7b782f99 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:09.547632 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-46977d4e-34c1-4034-acb1-ac7f7b782f99 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:09.564172 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-46977d4e-34c1-4034-acb1-ac7f7b782f99 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] HTTP exception thrown: Instance b71966c1-f9be-4c1c-b1b3-0b9b87351800 could not be found. Aug 24 19:34:09.564806 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-46977d4e-34c1-4034-acb1-ac7f7b782f99 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] Returning 404 to user: Instance b71966c1-f9be-4c1c-b1b3-0b9b87351800 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:34:09.565871 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-46977d4e-34c1-4034-acb1-ac7f7b782f99 tempest-VolumesActionsTest-1526513977 tempest-VolumesActionsTest-1526513977-project] 10.222.0.59 "GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800" status: 404 len: 111 microversion: 2.1 time: 0.031327 Aug 24 19:34:09.566412 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 396/808] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:09 2021] GET /compute/v2.1/servers/b71966c1-f9be-4c1c-b1b3-0b9b87351800 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:34:09.848383 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-2603729b-37f1-4ff7-90fa-578fbc14f615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:09.849338 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-2603729b-37f1-4ff7-90fa-578fbc14f615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:09.855700 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2603729b-37f1-4ff7-90fa-578fbc14f615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:09.856142 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2603729b-37f1-4ff7-90fa-578fbc14f615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:09.857062 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2603729b-37f1-4ff7-90fa-578fbc14f615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:09.857488 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2603729b-37f1-4ff7-90fa-578fbc14f615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:10.238568 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2603729b-37f1-4ff7-90fa-578fbc14f615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:10.255595 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2603729b-37f1-4ff7-90fa-578fbc14f615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:10.257315 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2603729b-37f1-4ff7-90fa-578fbc14f615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:10.258493 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-2603729b-37f1-4ff7-90fa-578fbc14f615 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.414116 Aug 24 19:34:10.262576 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 413/809] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:09 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:10.785806 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-358abf11-7037-463a-991c-f02bf7d9009b req-98b861b3-8043-4953-9fae-b5664825e062 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff70d818-92c2-45bf-b298-96a45eb576a3", "tag": "9eae3e9d-b91a-4a71-8862-9ab8e3b42579"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:34:10.787360 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:34:10.787360 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:34:10.796017 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-358abf11-7037-463a-991c-f02bf7d9009b req-98b861b3-8043-4953-9fae-b5664825e062 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:10.796685 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-358abf11-7037-463a-991c-f02bf7d9009b req-98b861b3-8043-4953-9fae-b5664825e062 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:10.814293 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-358abf11-7037-463a-991c-f02bf7d9009b req-98b861b3-8043-4953-9fae-b5664825e062 service nova] Creating event network-changed:9eae3e9d-b91a-4a71-8862-9ab8e3b42579 for instance ff70d818-92c2-45bf-b298-96a45eb576a3 on hv-cinder-79819 Aug 24 19:34:10.820107 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-358abf11-7037-463a-991c-f02bf7d9009b req-98b861b3-8043-4953-9fae-b5664825e062 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037965 Aug 24 19:34:10.821204 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 397/810] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:34:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:34:11.277453 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b532f449-2dcb-4707-8213-053d97726e5b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:11.278728 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b532f449-2dcb-4707-8213-053d97726e5b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:11.290514 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b532f449-2dcb-4707-8213-053d97726e5b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:11.291812 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b532f449-2dcb-4707-8213-053d97726e5b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:11.293352 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b532f449-2dcb-4707-8213-053d97726e5b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:11.294278 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b532f449-2dcb-4707-8213-053d97726e5b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:11.684378 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b532f449-2dcb-4707-8213-053d97726e5b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:11.685025 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5d343dfc-d046-4b47-b3b7-080e0996b1a9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:11.685721 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5d343dfc-d046-4b47-b3b7-080e0996b1a9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:11.698823 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b532f449-2dcb-4707-8213-053d97726e5b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:11.700623 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b532f449-2dcb-4707-8213-053d97726e5b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:11.702206 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b532f449-2dcb-4707-8213-053d97726e5b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.428620 Aug 24 19:34:11.709804 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 414/811] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:11 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:11.714336 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5d343dfc-d046-4b47-b3b7-080e0996b1a9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:11.714843 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5d343dfc-d046-4b47-b3b7-080e0996b1a9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:11.715684 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5d343dfc-d046-4b47-b3b7-080e0996b1a9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:11.716126 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5d343dfc-d046-4b47-b3b7-080e0996b1a9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:11.927415 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-5d343dfc-d046-4b47-b3b7-080e0996b1a9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:11.937333 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5d343dfc-d046-4b47-b3b7-080e0996b1a9 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1594 microversion: 2.1 time: 0.256687 Aug 24 19:34:11.938523 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 398/812] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:11 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1594 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:12.723192 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-cce37b33-480c-441c-be7f-d0f435912d6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:12.723788 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-cce37b33-480c-441c-be7f-d0f435912d6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:12.730825 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cce37b33-480c-441c-be7f-d0f435912d6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:12.731261 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cce37b33-480c-441c-be7f-d0f435912d6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:12.732013 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cce37b33-480c-441c-be7f-d0f435912d6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:12.732464 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cce37b33-480c-441c-be7f-d0f435912d6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:12.959036 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-cce37b33-480c-441c-be7f-d0f435912d6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:12.968216 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-cce37b33-480c-441c-be7f-d0f435912d6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:12.969732 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-cce37b33-480c-441c-be7f-d0f435912d6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:12.971872 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-cce37b33-480c-441c-be7f-d0f435912d6c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.252360 Aug 24 19:34:12.973325 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 415/813] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:12 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:13.991314 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9b9f9232-2541-4358-b7db-8819aca5b7de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:13.991899 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9b9f9232-2541-4358-b7db-8819aca5b7de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:13.998389 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9b9f9232-2541-4358-b7db-8819aca5b7de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:13.998831 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9b9f9232-2541-4358-b7db-8819aca5b7de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:13.999583 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9b9f9232-2541-4358-b7db-8819aca5b7de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:14.000011 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9b9f9232-2541-4358-b7db-8819aca5b7de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:14.498656 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9b9f9232-2541-4358-b7db-8819aca5b7de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:14.508254 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9b9f9232-2541-4358-b7db-8819aca5b7de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:14.513910 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9b9f9232-2541-4358-b7db-8819aca5b7de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:14.513910 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9b9f9232-2541-4358-b7db-8819aca5b7de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.523542 Aug 24 19:34:14.513910 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 399/814] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:13 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:15.110455 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-facdcf90-45bf-41e5-8ec8-0c3abbc79869 req-9b1e66c1-eea4-4325-8309-ae8235b707f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2057e6ea-d98d-4233-b304-42ed12ce391c", "tag": "0ce85f00-01ff-4d38-89a7-beb1609b7e9a"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:34:15.117611 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:34:15.117611 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:34:15.122129 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-facdcf90-45bf-41e5-8ec8-0c3abbc79869 req-9b1e66c1-eea4-4325-8309-ae8235b707f4 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:15.122810 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-facdcf90-45bf-41e5-8ec8-0c3abbc79869 req-9b1e66c1-eea4-4325-8309-ae8235b707f4 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:15.135058 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-facdcf90-45bf-41e5-8ec8-0c3abbc79869 req-9b1e66c1-eea4-4325-8309-ae8235b707f4 service nova] Creating event network-changed:0ce85f00-01ff-4d38-89a7-beb1609b7e9a for instance 2057e6ea-d98d-4233-b304-42ed12ce391c on hv-cinder-79819 Aug 24 19:34:15.140636 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-facdcf90-45bf-41e5-8ec8-0c3abbc79869 req-9b1e66c1-eea4-4325-8309-ae8235b707f4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033846 Aug 24 19:34:15.141569 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 416/815] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:34:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:34:15.536212 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a6482c6a-094a-444a-bc73-6d737556f833 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:15.536212 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a6482c6a-094a-444a-bc73-6d737556f833 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:15.538244 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6482c6a-094a-444a-bc73-6d737556f833 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:15.538703 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6482c6a-094a-444a-bc73-6d737556f833 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:15.539480 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6482c6a-094a-444a-bc73-6d737556f833 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:15.540105 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6482c6a-094a-444a-bc73-6d737556f833 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:15.726871 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a6482c6a-094a-444a-bc73-6d737556f833 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:15.736469 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a6482c6a-094a-444a-bc73-6d737556f833 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:15.737954 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a6482c6a-094a-444a-bc73-6d737556f833 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:15.739114 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a6482c6a-094a-444a-bc73-6d737556f833 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.212101 Aug 24 19:34:15.739752 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 400/816] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:15 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:16.760256 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-54b5ebcd-79c7-46f9-8623-360ca985f511 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:16.761094 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-54b5ebcd-79c7-46f9-8623-360ca985f511 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:16.767577 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-54b5ebcd-79c7-46f9-8623-360ca985f511 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:16.768279 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-54b5ebcd-79c7-46f9-8623-360ca985f511 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:16.769148 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-54b5ebcd-79c7-46f9-8623-360ca985f511 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:16.770089 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-54b5ebcd-79c7-46f9-8623-360ca985f511 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:16.926669 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-54b5ebcd-79c7-46f9-8623-360ca985f511 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:16.935947 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-54b5ebcd-79c7-46f9-8623-360ca985f511 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:16.944862 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-54b5ebcd-79c7-46f9-8623-360ca985f511 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:16.951913 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-54b5ebcd-79c7-46f9-8623-360ca985f511 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.191829 Aug 24 19:34:16.956416 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 417/817] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:16 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:17.970822 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6a7554e0-1c73-48b6-a341-cc2ef28b5b4a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:17.971429 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6a7554e0-1c73-48b6-a341-cc2ef28b5b4a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:17.979268 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6a7554e0-1c73-48b6-a341-cc2ef28b5b4a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:17.979615 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6a7554e0-1c73-48b6-a341-cc2ef28b5b4a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:17.980423 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6a7554e0-1c73-48b6-a341-cc2ef28b5b4a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:17.980856 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6a7554e0-1c73-48b6-a341-cc2ef28b5b4a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:18.062948 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-0f5cae2a-7d9c-450a-a9e3-87f567b37268 req-22e6b261-ff70-4d3e-b382-079a0efe25a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c70c776-ec7a-4970-9d9f-baf8c6568257", "name": "network-vif-plugged", "status": "completed", "tag": "39906ad8-eb91-4f23-8e1c-cbdd3d7aa570"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:34:18.064901 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:34:18.064901 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:34:18.077766 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-0f5cae2a-7d9c-450a-a9e3-87f567b37268 req-22e6b261-ff70-4d3e-b382-079a0efe25a6 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:18.078505 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-0f5cae2a-7d9c-450a-a9e3-87f567b37268 req-22e6b261-ff70-4d3e-b382-079a0efe25a6 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:18.101206 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-0f5cae2a-7d9c-450a-a9e3-87f567b37268 req-22e6b261-ff70-4d3e-b382-079a0efe25a6 service nova] Creating event network-vif-plugged:39906ad8-eb91-4f23-8e1c-cbdd3d7aa570 for instance 7c70c776-ec7a-4970-9d9f-baf8c6568257 on hv-cinder-79819 Aug 24 19:34:18.113073 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-0f5cae2a-7d9c-450a-a9e3-87f567b37268 req-22e6b261-ff70-4d3e-b382-079a0efe25a6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053673 Aug 24 19:34:18.114503 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 418/818] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:34:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:34:18.239948 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6a7554e0-1c73-48b6-a341-cc2ef28b5b4a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:18.260253 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6a7554e0-1c73-48b6-a341-cc2ef28b5b4a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:18.262374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6a7554e0-1c73-48b6-a341-cc2ef28b5b4a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:18.263767 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6a7554e0-1c73-48b6-a341-cc2ef28b5b4a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.296769 Aug 24 19:34:18.277259 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 401/819] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:17 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:19.076873 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-69b12008-1af1-47d1-bf4c-888942f65a2c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1714711462"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:34:19.078224 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-69b12008-1af1-47d1-bf4c-888942f65a2c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:19.084754 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-69b12008-1af1-47d1-bf4c-888942f65a2c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:19.085219 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-69b12008-1af1-47d1-bf4c-888942f65a2c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:19.085959 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-69b12008-1af1-47d1-bf4c-888942f65a2c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:19.086380 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-69b12008-1af1-47d1-bf4c-888942f65a2c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:19.229164 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.network.security_group_api [None req-69b12008-1af1-47d1-bf4c-888942f65a2c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Adding security group 25a9a168-302d-46d0-bfdb-fb3adc0b8a09 to port 0ce85f00-01ff-4d38-89a7-beb1609b7e9a Aug 24 19:34:19.285626 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-94b97b69-9551-4a9b-b88c-6bcb3a3e6841 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:19.286948 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-94b97b69-9551-4a9b-b88c-6bcb3a3e6841 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:19.307250 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-94b97b69-9551-4a9b-b88c-6bcb3a3e6841 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:19.308874 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-94b97b69-9551-4a9b-b88c-6bcb3a3e6841 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:19.309730 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-94b97b69-9551-4a9b-b88c-6bcb3a3e6841 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:19.310176 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-94b97b69-9551-4a9b-b88c-6bcb3a3e6841 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:19.522899 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-94b97b69-9551-4a9b-b88c-6bcb3a3e6841 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:19.533255 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-94b97b69-9551-4a9b-b88c-6bcb3a3e6841 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:19.535284 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-94b97b69-9551-4a9b-b88c-6bcb3a3e6841 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:19.536870 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-94b97b69-9551-4a9b-b88c-6bcb3a3e6841 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.258225 Aug 24 19:34:19.549890 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 402/820] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:19 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:19.815310 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-69b12008-1af1-47d1-bf4c-888942f65a2c tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "POST /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/action" status: 202 len: 0 microversion: 2.1 time: 0.744262 Aug 24 19:34:19.816328 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 419/821] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:34:19 2021] POST /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:34:19.830971 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9d4e7e2c-c9fb-4a05-9312-6ad2c0a0ef95 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:19.831579 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9d4e7e2c-c9fb-4a05-9312-6ad2c0a0ef95 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:19.841952 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9d4e7e2c-c9fb-4a05-9312-6ad2c0a0ef95 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:19.842747 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9d4e7e2c-c9fb-4a05-9312-6ad2c0a0ef95 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:19.844917 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9d4e7e2c-c9fb-4a05-9312-6ad2c0a0ef95 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:19.845988 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-3835cb95-766f-41f1-85ef-9cf451a9974b req-9e9eb06b-2deb-4be2-b1af-f04af5ec9c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2057e6ea-d98d-4233-b304-42ed12ce391c", "tag": "0ce85f00-01ff-4d38-89a7-beb1609b7e9a"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:34:19.846765 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9d4e7e2c-c9fb-4a05-9312-6ad2c0a0ef95 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:19.853008 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:34:19.853008 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:34:19.897732 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-3835cb95-766f-41f1-85ef-9cf451a9974b req-9e9eb06b-2deb-4be2-b1af-f04af5ec9c0c service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:19.901273 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-3835cb95-766f-41f1-85ef-9cf451a9974b req-9e9eb06b-2deb-4be2-b1af-f04af5ec9c0c service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:19.969453 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-3835cb95-766f-41f1-85ef-9cf451a9974b req-9e9eb06b-2deb-4be2-b1af-f04af5ec9c0c service nova] Creating event network-changed:0ce85f00-01ff-4d38-89a7-beb1609b7e9a for instance 2057e6ea-d98d-4233-b304-42ed12ce391c on hv-cinder-79819 Aug 24 19:34:19.983201 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-3835cb95-766f-41f1-85ef-9cf451a9974b req-9e9eb06b-2deb-4be2-b1af-f04af5ec9c0c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156082 Aug 24 19:34:19.984599 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 403/822] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:34:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:34:20.109339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9d4e7e2c-c9fb-4a05-9312-6ad2c0a0ef95 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:20.123348 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9d4e7e2c-c9fb-4a05-9312-6ad2c0a0ef95 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1760 microversion: 2.1 time: 0.293237 Aug 24 19:34:20.125345 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 420/823] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:19 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1760 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:20.566910 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-87e29b3d-6c57-4c2c-b01e-e79baa9ad93e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:20.568730 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-87e29b3d-6c57-4c2c-b01e-e79baa9ad93e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:20.581107 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-87e29b3d-6c57-4c2c-b01e-e79baa9ad93e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:20.582928 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-87e29b3d-6c57-4c2c-b01e-e79baa9ad93e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:20.585053 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-87e29b3d-6c57-4c2c-b01e-e79baa9ad93e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:20.588354 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-87e29b3d-6c57-4c2c-b01e-e79baa9ad93e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:20.852412 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-87e29b3d-6c57-4c2c-b01e-e79baa9ad93e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:20.863654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-87e29b3d-6c57-4c2c-b01e-e79baa9ad93e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:20.865877 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-87e29b3d-6c57-4c2c-b01e-e79baa9ad93e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:20.867497 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-87e29b3d-6c57-4c2c-b01e-e79baa9ad93e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.315697 Aug 24 19:34:20.869184 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 404/824] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:20 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:21.886597 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-2fc2555a-d974-4736-a429-e76239374830 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:21.888067 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-2fc2555a-d974-4736-a429-e76239374830 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:21.896054 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2fc2555a-d974-4736-a429-e76239374830 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:21.897014 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2fc2555a-d974-4736-a429-e76239374830 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:21.898790 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2fc2555a-d974-4736-a429-e76239374830 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:21.899434 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2fc2555a-d974-4736-a429-e76239374830 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:22.039768 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2fc2555a-d974-4736-a429-e76239374830 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:22.050086 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2fc2555a-d974-4736-a429-e76239374830 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:22.052781 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2fc2555a-d974-4736-a429-e76239374830 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:22.052898 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-2fc2555a-d974-4736-a429-e76239374830 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.170317 Aug 24 19:34:22.053415 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 421/825] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:21 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:23.071280 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5f0aecaf-fd85-4fbd-8bb8-e64bc8f182b3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:23.071983 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5f0aecaf-fd85-4fbd-8bb8-e64bc8f182b3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:23.080287 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5f0aecaf-fd85-4fbd-8bb8-e64bc8f182b3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:23.083339 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5f0aecaf-fd85-4fbd-8bb8-e64bc8f182b3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:23.083339 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5f0aecaf-fd85-4fbd-8bb8-e64bc8f182b3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:23.083339 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5f0aecaf-fd85-4fbd-8bb8-e64bc8f182b3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:23.222040 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-5f0aecaf-fd85-4fbd-8bb8-e64bc8f182b3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:23.231411 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-5f0aecaf-fd85-4fbd-8bb8-e64bc8f182b3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:23.232967 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-5f0aecaf-fd85-4fbd-8bb8-e64bc8f182b3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:23.234132 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5f0aecaf-fd85-4fbd-8bb8-e64bc8f182b3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.166564 Aug 24 19:34:23.234798 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 405/826] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:23 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:34:24.253477 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-552a5918-9bb9-4ca2-8f0a-e75cf45608a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:24.253841 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-552a5918-9bb9-4ca2-8f0a-e75cf45608a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:24.260998 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-552a5918-9bb9-4ca2-8f0a-e75cf45608a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:24.261739 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-552a5918-9bb9-4ca2-8f0a-e75cf45608a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:24.262783 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-552a5918-9bb9-4ca2-8f0a-e75cf45608a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:24.263452 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-552a5918-9bb9-4ca2-8f0a-e75cf45608a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:24.409493 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-552a5918-9bb9-4ca2-8f0a-e75cf45608a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:24.423732 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-552a5918-9bb9-4ca2-8f0a-e75cf45608a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:24.425878 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-552a5918-9bb9-4ca2-8f0a-e75cf45608a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:24.429158 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-552a5918-9bb9-4ca2-8f0a-e75cf45608a3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.177666 Aug 24 19:34:24.439214 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 422/827] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:24 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:34:25.451308 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e7a0b57f-ee57-4ae1-9d6d-387627586b71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:25.451907 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e7a0b57f-ee57-4ae1-9d6d-387627586b71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:25.458109 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e7a0b57f-ee57-4ae1-9d6d-387627586b71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:25.458585 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e7a0b57f-ee57-4ae1-9d6d-387627586b71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:25.459641 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e7a0b57f-ee57-4ae1-9d6d-387627586b71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:25.460090 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e7a0b57f-ee57-4ae1-9d6d-387627586b71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:25.607472 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e7a0b57f-ee57-4ae1-9d6d-387627586b71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:25.613791 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e7a0b57f-ee57-4ae1-9d6d-387627586b71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:25.615919 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e7a0b57f-ee57-4ae1-9d6d-387627586b71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:25.617597 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e7a0b57f-ee57-4ae1-9d6d-387627586b71 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.175166 Aug 24 19:34:25.620031 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 406/828] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:25 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:26.642786 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fc906da4-dd61-4915-bb65-e23aef797e90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:26.643762 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fc906da4-dd61-4915-bb65-e23aef797e90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:26.649943 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fc906da4-dd61-4915-bb65-e23aef797e90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:26.650396 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fc906da4-dd61-4915-bb65-e23aef797e90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:26.651274 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fc906da4-dd61-4915-bb65-e23aef797e90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:26.651761 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fc906da4-dd61-4915-bb65-e23aef797e90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:26.784956 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fc906da4-dd61-4915-bb65-e23aef797e90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:26.796010 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fc906da4-dd61-4915-bb65-e23aef797e90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:26.797865 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fc906da4-dd61-4915-bb65-e23aef797e90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:26.799127 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-fc906da4-dd61-4915-bb65-e23aef797e90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1807 microversion: 2.20 time: 0.160166 Aug 24 19:34:26.799926 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 423/829] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:26 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:27.819942 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b2c1c1a9-8f24-443b-a000-310c3eab6b7c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:27.820633 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b2c1c1a9-8f24-443b-a000-310c3eab6b7c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:27.839668 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b2c1c1a9-8f24-443b-a000-310c3eab6b7c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:27.843191 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b2c1c1a9-8f24-443b-a000-310c3eab6b7c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:27.844356 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b2c1c1a9-8f24-443b-a000-310c3eab6b7c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:27.845031 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b2c1c1a9-8f24-443b-a000-310c3eab6b7c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:28.019534 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b2c1c1a9-8f24-443b-a000-310c3eab6b7c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:28.027662 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b2c1c1a9-8f24-443b-a000-310c3eab6b7c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:28.029166 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b2c1c1a9-8f24-443b-a000-310c3eab6b7c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:28.037186 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b2c1c1a9-8f24-443b-a000-310c3eab6b7c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1794 microversion: 2.20 time: 0.214653 Aug 24 19:34:28.037186 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 407/830] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:34:27 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1794 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:34:39.515931 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1cc374a2-53b7-4d59-b97d-4a58781559f4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:34:39.517079 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1cc374a2-53b7-4d59-b97d-4a58781559f4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:39.523674 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1cc374a2-53b7-4d59-b97d-4a58781559f4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:39.524496 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1cc374a2-53b7-4d59-b97d-4a58781559f4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:39.527687 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1cc374a2-53b7-4d59-b97d-4a58781559f4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:39.527687 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1cc374a2-53b7-4d59-b97d-4a58781559f4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:39.887856 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1cc374a2-53b7-4d59-b97d-4a58781559f4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "POST /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/action" status: 202 len: 0 microversion: 2.1 time: 0.375534 Aug 24 19:34:39.888531 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 424/831] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:34:39 2021] POST /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:34:39.896325 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-65626ac5-b6f7-476c-9f70-0e06b0ab5504 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:39.896930 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-65626ac5-b6f7-476c-9f70-0e06b0ab5504 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:39.903364 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65626ac5-b6f7-476c-9f70-0e06b0ab5504 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:39.903808 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65626ac5-b6f7-476c-9f70-0e06b0ab5504 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:39.904632 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65626ac5-b6f7-476c-9f70-0e06b0ab5504 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:39.905062 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-65626ac5-b6f7-476c-9f70-0e06b0ab5504 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:40.027155 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-65626ac5-b6f7-476c-9f70-0e06b0ab5504 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:40.035528 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-65626ac5-b6f7-476c-9f70-0e06b0ab5504 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1752 microversion: 2.1 time: 0.142820 Aug 24 19:34:40.036102 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 408/832] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:39 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1752 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:41.053329 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f2f95dfa-ee0d-4201-820f-e611533b0c87 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:41.054678 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f2f95dfa-ee0d-4201-820f-e611533b0c87 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:41.060727 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f2f95dfa-ee0d-4201-820f-e611533b0c87 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:41.061173 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f2f95dfa-ee0d-4201-820f-e611533b0c87 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:41.061942 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f2f95dfa-ee0d-4201-820f-e611533b0c87 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:41.062371 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f2f95dfa-ee0d-4201-820f-e611533b0c87 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:41.194686 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f2f95dfa-ee0d-4201-820f-e611533b0c87 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:41.202438 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f2f95dfa-ee0d-4201-820f-e611533b0c87 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1752 microversion: 2.1 time: 0.153214 Aug 24 19:34:41.203000 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 425/833] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:41 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:42.218843 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5ce4b48f-9863-4c2b-bb04-91b2d0ced5d2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:42.219446 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5ce4b48f-9863-4c2b-bb04-91b2d0ced5d2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:42.226422 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5ce4b48f-9863-4c2b-bb04-91b2d0ced5d2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:42.226871 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5ce4b48f-9863-4c2b-bb04-91b2d0ced5d2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:42.227646 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5ce4b48f-9863-4c2b-bb04-91b2d0ced5d2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:42.228072 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5ce4b48f-9863-4c2b-bb04-91b2d0ced5d2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:42.354500 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-5ce4b48f-9863-4c2b-bb04-91b2d0ced5d2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:42.362498 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5ce4b48f-9863-4c2b-bb04-91b2d0ced5d2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1757 microversion: 2.1 time: 0.147441 Aug 24 19:34:42.363059 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 409/834] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:42 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1757 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:43.384053 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-981ca302-0291-4e37-a502-bf21417fa1cd tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:43.385164 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-981ca302-0291-4e37-a502-bf21417fa1cd tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:43.394336 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-981ca302-0291-4e37-a502-bf21417fa1cd tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:43.395060 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-981ca302-0291-4e37-a502-bf21417fa1cd tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:43.396314 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-981ca302-0291-4e37-a502-bf21417fa1cd tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:43.396858 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-981ca302-0291-4e37-a502-bf21417fa1cd tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:43.518956 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-981ca302-0291-4e37-a502-bf21417fa1cd tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:43.527231 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-981ca302-0291-4e37-a502-bf21417fa1cd tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1757 microversion: 2.1 time: 0.150038 Aug 24 19:34:43.527793 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 426/835] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:43 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1757 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:44.544477 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3f1176c2-2660-4aee-9be2-d0e8acc86060 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:44.545088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3f1176c2-2660-4aee-9be2-d0e8acc86060 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:44.551031 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3f1176c2-2660-4aee-9be2-d0e8acc86060 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:44.551599 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3f1176c2-2660-4aee-9be2-d0e8acc86060 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:44.552381 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3f1176c2-2660-4aee-9be2-d0e8acc86060 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:44.552827 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3f1176c2-2660-4aee-9be2-d0e8acc86060 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:44.691721 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3f1176c2-2660-4aee-9be2-d0e8acc86060 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:44.699974 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3f1176c2-2660-4aee-9be2-d0e8acc86060 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1757 microversion: 2.1 time: 0.159431 Aug 24 19:34:44.700574 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 410/836] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:44 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:45.716638 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b6769a80-ff96-4c30-bb96-91306c2c8ed2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:45.717273 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b6769a80-ff96-4c30-bb96-91306c2c8ed2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:45.723259 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b6769a80-ff96-4c30-bb96-91306c2c8ed2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:45.723707 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b6769a80-ff96-4c30-bb96-91306c2c8ed2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:45.724502 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b6769a80-ff96-4c30-bb96-91306c2c8ed2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:45.724939 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b6769a80-ff96-4c30-bb96-91306c2c8ed2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:45.866948 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b6769a80-ff96-4c30-bb96-91306c2c8ed2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:45.875658 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b6769a80-ff96-4c30-bb96-91306c2c8ed2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1757 microversion: 2.1 time: 0.162772 Aug 24 19:34:45.876444 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 427/837] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:45 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:46.892546 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3e87c92d-d91a-41aa-8055-5cbef56cf383 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:46.893725 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3e87c92d-d91a-41aa-8055-5cbef56cf383 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:46.899928 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3e87c92d-d91a-41aa-8055-5cbef56cf383 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:46.900323 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3e87c92d-d91a-41aa-8055-5cbef56cf383 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:46.901141 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3e87c92d-d91a-41aa-8055-5cbef56cf383 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:46.901577 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3e87c92d-d91a-41aa-8055-5cbef56cf383 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:47.039653 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3e87c92d-d91a-41aa-8055-5cbef56cf383 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:47.047383 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3e87c92d-d91a-41aa-8055-5cbef56cf383 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1757 microversion: 2.1 time: 0.158517 Aug 24 19:34:47.047950 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 411/838] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:46 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:48.064439 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7f28d07d-5c30-49d0-aca2-36d969ff7104 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:48.065038 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7f28d07d-5c30-49d0-aca2-36d969ff7104 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:48.071022 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7f28d07d-5c30-49d0-aca2-36d969ff7104 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:48.071454 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7f28d07d-5c30-49d0-aca2-36d969ff7104 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:48.072208 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7f28d07d-5c30-49d0-aca2-36d969ff7104 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:48.072695 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7f28d07d-5c30-49d0-aca2-36d969ff7104 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:48.222680 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7f28d07d-5c30-49d0-aca2-36d969ff7104 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:48.230854 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7f28d07d-5c30-49d0-aca2-36d969ff7104 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1757 microversion: 2.1 time: 0.170002 Aug 24 19:34:48.231411 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 428/839] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:48 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:49.248444 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-00a1e349-038f-42f1-badd-1c3ba337ed24 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:49.249089 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-00a1e349-038f-42f1-badd-1c3ba337ed24 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:49.255163 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-00a1e349-038f-42f1-badd-1c3ba337ed24 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:49.255610 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-00a1e349-038f-42f1-badd-1c3ba337ed24 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:49.256404 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-00a1e349-038f-42f1-badd-1c3ba337ed24 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:49.256836 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-00a1e349-038f-42f1-badd-1c3ba337ed24 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:49.378699 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-00a1e349-038f-42f1-badd-1c3ba337ed24 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:49.386367 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-00a1e349-038f-42f1-badd-1c3ba337ed24 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1757 microversion: 2.1 time: 0.141698 Aug 24 19:34:49.386930 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 412/840] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:49 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1757 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:50.402731 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8f34168e-039f-4f82-b1a2-121d8c2a0771 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:50.403367 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8f34168e-039f-4f82-b1a2-121d8c2a0771 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:50.409545 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f34168e-039f-4f82-b1a2-121d8c2a0771 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:50.409987 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f34168e-039f-4f82-b1a2-121d8c2a0771 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:50.410739 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f34168e-039f-4f82-b1a2-121d8c2a0771 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:50.411213 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8f34168e-039f-4f82-b1a2-121d8c2a0771 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:50.544730 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8f34168e-039f-4f82-b1a2-121d8c2a0771 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:50.552616 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8f34168e-039f-4f82-b1a2-121d8c2a0771 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1757 microversion: 2.1 time: 0.153491 Aug 24 19:34:50.553182 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 429/841] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:50 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1757 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:51.569829 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8679b2f1-495e-47af-b7a1-5f685bc956c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:51.570451 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8679b2f1-495e-47af-b7a1-5f685bc956c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:51.576440 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8679b2f1-495e-47af-b7a1-5f685bc956c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:51.576883 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8679b2f1-495e-47af-b7a1-5f685bc956c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:51.582760 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8679b2f1-495e-47af-b7a1-5f685bc956c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:51.582760 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8679b2f1-495e-47af-b7a1-5f685bc956c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:51.697495 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8679b2f1-495e-47af-b7a1-5f685bc956c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:51.705337 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8679b2f1-495e-47af-b7a1-5f685bc956c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1757 microversion: 2.1 time: 0.139110 Aug 24 19:34:51.705898 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 413/842] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:51 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1757 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:52.722497 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-44a647a9-129f-4d12-bb99-b5c0f3e062b8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:52.723099 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-44a647a9-129f-4d12-bb99-b5c0f3e062b8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:52.728991 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-44a647a9-129f-4d12-bb99-b5c0f3e062b8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:52.729447 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-44a647a9-129f-4d12-bb99-b5c0f3e062b8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:52.730189 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-44a647a9-129f-4d12-bb99-b5c0f3e062b8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:52.730616 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-44a647a9-129f-4d12-bb99-b5c0f3e062b8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:52.856012 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-44a647a9-129f-4d12-bb99-b5c0f3e062b8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:52.863885 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-44a647a9-129f-4d12-bb99-b5c0f3e062b8 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1757 microversion: 2.1 time: 0.145057 Aug 24 19:34:52.864471 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 430/843] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:52 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1757 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:53.880973 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-692cbb64-0461-40bc-99ad-ec88a308ed01 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:53.881583 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-692cbb64-0461-40bc-99ad-ec88a308ed01 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:53.887346 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-692cbb64-0461-40bc-99ad-ec88a308ed01 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:53.887789 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-692cbb64-0461-40bc-99ad-ec88a308ed01 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:53.888809 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-692cbb64-0461-40bc-99ad-ec88a308ed01 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:53.889525 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-692cbb64-0461-40bc-99ad-ec88a308ed01 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:54.018613 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-692cbb64-0461-40bc-99ad-ec88a308ed01 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:54.026942 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-692cbb64-0461-40bc-99ad-ec88a308ed01 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1757 microversion: 2.1 time: 0.149806 Aug 24 19:34:54.027525 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 414/844] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:53 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1757 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:55.042333 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: ERROR oslo.messaging._drivers.impl_rabbit [-] [549a2371-dff1-41c9-8c68-7d128b2598e0] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 19:34:55.045641 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5738c9ad-86ca-476b-98d7-12b2255ae603 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:55.046239 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5738c9ad-86ca-476b-98d7-12b2255ae603 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:55.052009 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5738c9ad-86ca-476b-98d7-12b2255ae603 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:55.052480 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5738c9ad-86ca-476b-98d7-12b2255ae603 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:55.053335 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5738c9ad-86ca-476b-98d7-12b2255ae603 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:55.053765 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5738c9ad-86ca-476b-98d7-12b2255ae603 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:55.192007 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5738c9ad-86ca-476b-98d7-12b2255ae603 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:55.201249 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5738c9ad-86ca-476b-98d7-12b2255ae603 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1757 microversion: 2.1 time: 0.160297 Aug 24 19:34:55.202022 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 431/845] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:55 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:56.222452 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1736bd3b-9a7b-4993-aacd-18c7c0c1c13d tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:56.223191 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1736bd3b-9a7b-4993-aacd-18c7c0c1c13d tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:56.229682 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1736bd3b-9a7b-4993-aacd-18c7c0c1c13d tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:56.230333 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1736bd3b-9a7b-4993-aacd-18c7c0c1c13d tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:56.231089 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1736bd3b-9a7b-4993-aacd-18c7c0c1c13d tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:56.231512 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1736bd3b-9a7b-4993-aacd-18c7c0c1c13d tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:56.356037 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1736bd3b-9a7b-4993-aacd-18c7c0c1c13d tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:56.364339 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1736bd3b-9a7b-4993-aacd-18c7c0c1c13d tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1757 microversion: 2.1 time: 0.147380 Aug 24 19:34:56.364941 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 415/846] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:56 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1757 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:57.382097 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-07792113-a2e2-4680-9e47-bba69e0e7734 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:57.382726 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-07792113-a2e2-4680-9e47-bba69e0e7734 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:57.399420 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-07792113-a2e2-4680-9e47-bba69e0e7734 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:57.399865 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-07792113-a2e2-4680-9e47-bba69e0e7734 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:57.400672 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-07792113-a2e2-4680-9e47-bba69e0e7734 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:57.401106 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-07792113-a2e2-4680-9e47-bba69e0e7734 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:57.419815 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO oslo.messaging._drivers.impl_rabbit [-] [549a2371-dff1-41c9-8c68-7d128b2598e0] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 33112. Aug 24 19:34:57.525717 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-07792113-a2e2-4680-9e47-bba69e0e7734 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:57.533809 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-07792113-a2e2-4680-9e47-bba69e0e7734 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1757 microversion: 2.1 time: 0.155302 Aug 24 19:34:57.534380 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 432/847] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:57 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1757 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:58.550876 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-89f777c7-f3bb-475f-907b-8c26272f08c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:58.551622 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-89f777c7-f3bb-475f-907b-8c26272f08c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:58.558724 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89f777c7-f3bb-475f-907b-8c26272f08c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:58.559165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89f777c7-f3bb-475f-907b-8c26272f08c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:58.559992 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89f777c7-f3bb-475f-907b-8c26272f08c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:58.560467 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89f777c7-f3bb-475f-907b-8c26272f08c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:58.741790 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-89f777c7-f3bb-475f-907b-8c26272f08c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:58.750568 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-89f777c7-f3bb-475f-907b-8c26272f08c0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1760 microversion: 2.1 time: 0.203427 Aug 24 19:34:58.754195 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 416/848] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:58 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1760 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:34:58.900214 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-622078a8-cbbc-424a-acc1-e77b6f1360a5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:58.901141 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-622078a8-cbbc-424a-acc1-e77b6f1360a5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:58.907539 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-622078a8-cbbc-424a-acc1-e77b6f1360a5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:58.907975 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-622078a8-cbbc-424a-acc1-e77b6f1360a5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:58.908770 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-622078a8-cbbc-424a-acc1-e77b6f1360a5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:58.909194 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-622078a8-cbbc-424a-acc1-e77b6f1360a5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:58.947423 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-622078a8-cbbc-424a-acc1-e77b6f1360a5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050984 Aug 24 19:34:58.948563 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 433/849] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:34:58 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:34:59.013219 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-af1b826d-dca2-4fac-a130-e104ebb2a8a2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:59.014176 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-af1b826d-dca2-4fac-a130-e104ebb2a8a2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:59.021791 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-af1b826d-dca2-4fac-a130-e104ebb2a8a2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:59.022439 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-af1b826d-dca2-4fac-a130-e104ebb2a8a2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:59.024027 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-af1b826d-dca2-4fac-a130-e104ebb2a8a2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:59.024763 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-af1b826d-dca2-4fac-a130-e104ebb2a8a2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:59.053169 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-af1b826d-dca2-4fac-a130-e104ebb2a8a2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Going to try to terminate instance {{(pid=108908) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:34:59.430685 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-af1b826d-dca2-4fac-a130-e104ebb2a8a2 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 204 len: 0 microversion: 2.1 time: 0.423413 Aug 24 19:34:59.431280 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 417/850] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:34:59 2021] DELETE /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:34:59.439328 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ee2f6e4e-73d3-419d-8c04-691dab4f40dd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:34:59.440012 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ee2f6e4e-73d3-419d-8c04-691dab4f40dd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:34:59.446684 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ee2f6e4e-73d3-419d-8c04-691dab4f40dd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:59.447135 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ee2f6e4e-73d3-419d-8c04-691dab4f40dd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:59.447898 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ee2f6e4e-73d3-419d-8c04-691dab4f40dd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:34:59.448361 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ee2f6e4e-73d3-419d-8c04-691dab4f40dd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:34:59.582701 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ee2f6e4e-73d3-419d-8c04-691dab4f40dd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:34:59.594961 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ee2f6e4e-73d3-419d-8c04-691dab4f40dd tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1672 microversion: 2.1 time: 0.158707 Aug 24 19:34:59.596302 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 434/851] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:34:59 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:00.613502 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4891e937-1c63-4c2e-8a30-197f093fa9f5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:00.614119 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4891e937-1c63-4c2e-8a30-197f093fa9f5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:00.619862 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4891e937-1c63-4c2e-8a30-197f093fa9f5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:00.620330 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4891e937-1c63-4c2e-8a30-197f093fa9f5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:00.621092 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4891e937-1c63-4c2e-8a30-197f093fa9f5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:00.621522 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4891e937-1c63-4c2e-8a30-197f093fa9f5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:00.848633 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4891e937-1c63-4c2e-8a30-197f093fa9f5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:00.856416 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4891e937-1c63-4c2e-8a30-197f093fa9f5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1672 microversion: 2.1 time: 0.247018 Aug 24 19:35:00.856985 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 418/852] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:00 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1672 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:01.587027 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1896115799", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "networks": [{"uuid": "518d0660-b1d0-41dc-b1d1-9a48109971f0"}]}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:01.735070 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.network.neutron [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] validate_networks() for [('518d0660-b1d0-41dc-b1d1-9a48109971f0', None, None, None, None, None)] {{(pid=108907) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:35:01.875118 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c341343e-0f13-4609-8823-a4b9e6fcb14c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:01.875756 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-c341343e-0f13-4609-8823-a4b9e6fcb14c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:01.882235 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c341343e-0f13-4609-8823-a4b9e6fcb14c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:01.882724 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c341343e-0f13-4609-8823-a4b9e6fcb14c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:01.883523 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c341343e-0f13-4609-8823-a4b9e6fcb14c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:01.883960 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c341343e-0f13-4609-8823-a4b9e6fcb14c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:02.207976 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-c341343e-0f13-4609-8823-a4b9e6fcb14c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:02.216159 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c341343e-0f13-4609-8823-a4b9e6fcb14c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1672 microversion: 2.1 time: 0.344858 Aug 24 19:35:02.217293 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 419/853] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:01 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1672 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:35:02.393580 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Flavor limits 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:35:02.393998 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Image limits 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:35:02.394465 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Flavor pref 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:35:02.394862 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Image pref 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:35:02.395261 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:35:02.404591 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:02.405058 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:02.405815 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:02.406238 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:02.422813 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Getting quotas for project 557992a6150e4dffb7039761938b1ee5. Resources: {'cores', 'ram', 'instances'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:35:02.426679 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Getting quotas for user f2dcc1b5cebb47ba8ed7283904b5775a and project 557992a6150e4dffb7039761938b1ee5. Resources: {'cores', 'ram', 'instances'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:35:02.437244 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Going to run 1 instances... {{(pid=108907) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:35:02.440055 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:35:02.598125 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-22942614-e893-4d4d-bf71-6cdb88124bf3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.014462 Aug 24 19:35:02.599160 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 435/854] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:35:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:35:02.609641 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f35d4210-896d-47fe-aea5-b7ac0b560c89 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:02.612323 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f35d4210-896d-47fe-aea5-b7ac0b560c89 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:02.678674 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f35d4210-896d-47fe-aea5-b7ac0b560c89 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:02.686032 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f35d4210-896d-47fe-aea5-b7ac0b560c89 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1219 microversion: 2.1 time: 0.080009 Aug 24 19:35:02.687400 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 420/855] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:02 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:02.761125 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-23ae16b5-491c-464b-bd46-be7e94150dce req-303b94e0-6201-492f-bac9-33dee4fe5fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01", "name": "network-vif-deleted", "tag": "adfe6c55-fc59-4263-be71-0135828820e8"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:02.763138 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:35:02.763138 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:35:02.771683 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-23ae16b5-491c-464b-bd46-be7e94150dce req-303b94e0-6201-492f-bac9-33dee4fe5fd1 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:02.772217 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-23ae16b5-491c-464b-bd46-be7e94150dce req-303b94e0-6201-492f-bac9-33dee4fe5fd1 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:02.784405 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-23ae16b5-491c-464b-bd46-be7e94150dce req-303b94e0-6201-492f-bac9-33dee4fe5fd1 service nova] Creating event network-vif-deleted:adfe6c55-fc59-4263-be71-0135828820e8 for instance a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 on hv-cinder-79819 Aug 24 19:35:02.789750 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-23ae16b5-491c-464b-bd46-be7e94150dce req-303b94e0-6201-492f-bac9-33dee4fe5fd1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035798 Aug 24 19:35:02.790488 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 436/856] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:35:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:35:03.234351 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d87ca6f1-45b0-47a6-97f0-f1c60fad28ae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:03.235914 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d87ca6f1-45b0-47a6-97f0-f1c60fad28ae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:03.269488 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d87ca6f1-45b0-47a6-97f0-f1c60fad28ae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:03.270160 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d87ca6f1-45b0-47a6-97f0-f1c60fad28ae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:03.271100 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d87ca6f1-45b0-47a6-97f0-f1c60fad28ae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:03.277243 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d87ca6f1-45b0-47a6-97f0-f1c60fad28ae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:03.335285 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d87ca6f1-45b0-47a6-97f0-f1c60fad28ae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:03.336675 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d87ca6f1-45b0-47a6-97f0-f1c60fad28ae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:03.337338 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.objects.instance [None req-d87ca6f1-45b0-47a6-97f0-f1c60fad28ae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lazy-loading 'fault' on Instance uuid a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 {{(pid=108908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:35:03.393476 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d87ca6f1-45b0-47a6-97f0-f1c60fad28ae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:03.400939 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d87ca6f1-45b0-47a6-97f0-f1c60fad28ae tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 200 len: 1327 microversion: 2.1 time: 0.170646 Aug 24 19:35:03.402091 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 421/857] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:03 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 1327 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:03.703322 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-af9a1358-70f5-4a7f-b592-6e4991d4a2b9 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:03.704011 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-af9a1358-70f5-4a7f-b592-6e4991d4a2b9 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:03.762700 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-af9a1358-70f5-4a7f-b592-6e4991d4a2b9 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:03.773388 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-af9a1358-70f5-4a7f-b592-6e4991d4a2b9 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1219 microversion: 2.1 time: 0.073354 Aug 24 19:35:03.773972 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 437/858] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:03 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:04.418883 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a6b13ca5-5087-432b-8241-0d0941231e8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:04.419859 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a6b13ca5-5087-432b-8241-0d0941231e8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:04.426247 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6b13ca5-5087-432b-8241-0d0941231e8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:04.427040 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6b13ca5-5087-432b-8241-0d0941231e8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:04.427969 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6b13ca5-5087-432b-8241-0d0941231e8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:04.428503 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6b13ca5-5087-432b-8241-0d0941231e8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:04.443042 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-a6b13ca5-5087-432b-8241-0d0941231e8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] HTTP exception thrown: Instance a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 could not be found. Aug 24 19:35:04.444385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a6b13ca5-5087-432b-8241-0d0941231e8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Returning 404 to user: Instance a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:35:04.445418 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a6b13ca5-5087-432b-8241-0d0941231e8e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 404 len: 111 microversion: 2.1 time: 0.029508 Aug 24 19:35:04.446555 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 422/859] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:04 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:35:04.454583 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-69a1591f-ac18-4645-b0a4-f1e7af79e2b7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '.version_select at 0x7f8df74969d0>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:04.585900 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-69a1591f-ac18-4645-b0a4-f1e7af79e2b7 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231874078" status: 202 len: 0 microversion: 2.1 time: 0.134870 Aug 24 19:35:04.586468 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 438/860] 10.222.0.59 () {58 vars in 1221 bytes} [Tue Aug 24 19:35:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1231874078 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:35:04.792311 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5f1b02b5-9703-4d3a-bf31-f81167818b3b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:04.793171 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5f1b02b5-9703-4d3a-bf31-f81167818b3b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:04.802730 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5f1b02b5-9703-4d3a-bf31-f81167818b3b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:04.803432 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5f1b02b5-9703-4d3a-bf31-f81167818b3b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:04.804955 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5f1b02b5-9703-4d3a-bf31-f81167818b3b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:04.805536 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5f1b02b5-9703-4d3a-bf31-f81167818b3b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:04.884541 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-5f1b02b5-9703-4d3a-bf31-f81167818b3b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:04.892153 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5f1b02b5-9703-4d3a-bf31-f81167818b3b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1271 microversion: 2.1 time: 0.105387 Aug 24 19:35:04.892856 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 423/861] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:04 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:35:05.766748 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1ed5bf68-db7a-415c-8aea-2a92e63f4f79 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'create', calling method: .version_select at 0x7f8df742f3a0>, body: {"keypair": {"name": "tempest-keypair-1944946648"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:05.785804 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-1ed5bf68-db7a-415c-8aea-2a92e63f4f79 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Getting quotas for project 0bcba9a91f5e4855bdf5044613de0321. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:35:05.790515 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-1ed5bf68-db7a-415c-8aea-2a92e63f4f79 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Getting quotas for user b3a89d7e4c2040ab814a75c5463d9f2a and project 0bcba9a91f5e4855bdf5044613de0321. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:35:05.917885 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-72f256ee-237e-46e3-b800-a206b49f2b23 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:05.918426 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-72f256ee-237e-46e3-b800-a206b49f2b23 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:05.926068 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-72f256ee-237e-46e3-b800-a206b49f2b23 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:05.926818 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-72f256ee-237e-46e3-b800-a206b49f2b23 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:05.927815 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-72f256ee-237e-46e3-b800-a206b49f2b23 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:05.928502 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-72f256ee-237e-46e3-b800-a206b49f2b23 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:06.003326 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-72f256ee-237e-46e3-b800-a206b49f2b23 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:06.011359 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-72f256ee-237e-46e3-b800-a206b49f2b23 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1277 microversion: 2.1 time: 0.104897 Aug 24 19:35:06.017100 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 424/862] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:05 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1277 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:06.221244 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-1ed5bf68-db7a-415c-8aea-2a92e63f4f79 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Getting quotas for project 0bcba9a91f5e4855bdf5044613de0321. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:35:06.224860 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-1ed5bf68-db7a-415c-8aea-2a92e63f4f79 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Getting quotas for user b3a89d7e4c2040ab814a75c5463d9f2a and project 0bcba9a91f5e4855bdf5044613de0321. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:35:06.237381 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1ed5bf68-db7a-415c-8aea-2a92e63f4f79 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.474328 Aug 24 19:35:06.237958 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 439/863] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Aug 24 19:35:05 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:07.028046 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e7907fac-b1c9-44c0-ba92-2cb5bbfc4826 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:07.028682 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e7907fac-b1c9-44c0-ba92-2cb5bbfc4826 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:07.034902 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e7907fac-b1c9-44c0-ba92-2cb5bbfc4826 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:07.035283 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e7907fac-b1c9-44c0-ba92-2cb5bbfc4826 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:07.036061 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e7907fac-b1c9-44c0-ba92-2cb5bbfc4826 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:07.036550 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e7907fac-b1c9-44c0-ba92-2cb5bbfc4826 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:07.154780 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e7907fac-b1c9-44c0-ba92-2cb5bbfc4826 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:07.162125 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e7907fac-b1c9-44c0-ba92-2cb5bbfc4826 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1319 microversion: 2.1 time: 0.137818 Aug 24 19:35:07.162687 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 425/864] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:07 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1319 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:07.635199 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-b5c60a32-5845-41f3-81a2-c2edf3fb102d req-c4bc41cb-af9d-4ce4-9952-f91201eb55d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "912de8e3-51dc-4fa5-89fd-b59b6c4ef269", "tag": "e94ceb52-3b3d-42f2-9e6b-4283c1fbbb3d"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:07.637064 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:35:07.637064 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:35:07.646170 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-b5c60a32-5845-41f3-81a2-c2edf3fb102d req-c4bc41cb-af9d-4ce4-9952-f91201eb55d0 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:07.646713 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-b5c60a32-5845-41f3-81a2-c2edf3fb102d req-c4bc41cb-af9d-4ce4-9952-f91201eb55d0 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:07.665354 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-b5c60a32-5845-41f3-81a2-c2edf3fb102d req-c4bc41cb-af9d-4ce4-9952-f91201eb55d0 service nova] Creating event network-changed:e94ceb52-3b3d-42f2-9e6b-4283c1fbbb3d for instance 912de8e3-51dc-4fa5-89fd-b59b6c4ef269 on hv-cinder-79819 Aug 24 19:35:07.669022 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-b5c60a32-5845-41f3-81a2-c2edf3fb102d req-c4bc41cb-af9d-4ce4-9952-f91201eb55d0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038854 Aug 24 19:35:07.669699 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 440/865] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:35:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:35:08.181015 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-455104ff-d4db-4f34-a8a2-f3f6a528c4d9 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:08.181655 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-455104ff-d4db-4f34-a8a2-f3f6a528c4d9 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:08.187710 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-455104ff-d4db-4f34-a8a2-f3f6a528c4d9 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:08.190699 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-455104ff-d4db-4f34-a8a2-f3f6a528c4d9 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:08.190699 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-455104ff-d4db-4f34-a8a2-f3f6a528c4d9 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:08.190699 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-455104ff-d4db-4f34-a8a2-f3f6a528c4d9 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:08.332969 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-455104ff-d4db-4f34-a8a2-f3f6a528c4d9 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:08.341348 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-455104ff-d4db-4f34-a8a2-f3f6a528c4d9 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1319 microversion: 2.1 time: 0.164613 Aug 24 19:35:08.342668 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 426/866] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:08 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:35:09.358680 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c7436faf-415c-4330-874b-826f7f358e63 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:09.359426 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c7436faf-415c-4330-874b-826f7f358e63 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:09.365415 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7436faf-415c-4330-874b-826f7f358e63 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:09.365853 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7436faf-415c-4330-874b-826f7f358e63 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:09.366692 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7436faf-415c-4330-874b-826f7f358e63 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:09.367033 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7436faf-415c-4330-874b-826f7f358e63 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:09.493048 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c7436faf-415c-4330-874b-826f7f358e63 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:09.500347 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c7436faf-415c-4330-874b-826f7f358e63 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1319 microversion: 2.1 time: 0.145587 Aug 24 19:35:09.500997 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 441/867] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:09 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:09.552043 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-927425139", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "15cf5dcf-738d-44b5-831d-34d65a4aa388"}], "security_groups": [{"name": "tempest-securitygroup--1255847716"}], "key_name": "tempest-keypair-1944946648", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:09.643738 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.network.neutron [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] validate_networks() for [('15cf5dcf-738d-44b5-831d-34d65a4aa388', None, None, None, None, None)] {{(pid=108908) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:35:10.049296 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Flavor limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:35:10.049772 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Image limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:35:10.050248 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Flavor pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:35:10.050653 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Image pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:35:10.051058 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:35:10.060203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:10.060696 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:10.061483 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:10.061912 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:10.078284 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Getting quotas for project 0bcba9a91f5e4855bdf5044613de0321. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:35:10.082113 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Getting quotas for user b3a89d7e4c2040ab814a75c5463d9f2a and project 0bcba9a91f5e4855bdf5044613de0321. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:35:10.092895 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Going to run 1 instances... {{(pid=108908) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:35:10.095209 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:35:10.271405 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2a9cf90a-8a21-429b-bb65-9eae9d9c1c2a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.723318 Aug 24 19:35:10.276319 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 427/868] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:35:09 2021] POST /compute/v2.1/servers => generated 402 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:35:10.282659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7636641a-ecae-4533-81f0-d169fc721167 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:10.283276 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7636641a-ecae-4533-81f0-d169fc721167 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:10.336445 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7636641a-ecae-4533-81f0-d169fc721167 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:10.342885 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7636641a-ecae-4533-81f0-d169fc721167 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1237 microversion: 2.1 time: 0.064237 Aug 24 19:35:10.343643 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 442/869] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:10 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:10.517417 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4d4e8947-baa2-4166-a85d-c13b148ad8e3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:10.518166 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4d4e8947-baa2-4166-a85d-c13b148ad8e3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:10.525678 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4d4e8947-baa2-4166-a85d-c13b148ad8e3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:10.526129 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4d4e8947-baa2-4166-a85d-c13b148ad8e3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:10.526921 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4d4e8947-baa2-4166-a85d-c13b148ad8e3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:10.527352 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4d4e8947-baa2-4166-a85d-c13b148ad8e3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:10.650479 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4d4e8947-baa2-4166-a85d-c13b148ad8e3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:10.658001 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4d4e8947-baa2-4166-a85d-c13b148ad8e3 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1319 microversion: 2.1 time: 0.144401 Aug 24 19:35:10.658569 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 428/870] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:10 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:11.359963 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-16c7a7a9-3a84-467b-8b8b-a1a6b09384bf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:11.360527 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-16c7a7a9-3a84-467b-8b8b-a1a6b09384bf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:11.366888 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-16c7a7a9-3a84-467b-8b8b-a1a6b09384bf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:11.367334 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-16c7a7a9-3a84-467b-8b8b-a1a6b09384bf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:11.368149 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-16c7a7a9-3a84-467b-8b8b-a1a6b09384bf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:11.368528 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-16c7a7a9-3a84-467b-8b8b-a1a6b09384bf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:11.429064 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-16c7a7a9-3a84-467b-8b8b-a1a6b09384bf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:11.436241 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-16c7a7a9-3a84-467b-8b8b-a1a6b09384bf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1241 microversion: 2.1 time: 0.080058 Aug 24 19:35:11.436820 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 443/871] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:11 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:11.674861 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9d540eb2-c3b9-499b-a608-c3e9f207137d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:11.675633 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9d540eb2-c3b9-499b-a608-c3e9f207137d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:11.682272 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9d540eb2-c3b9-499b-a608-c3e9f207137d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:11.682714 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9d540eb2-c3b9-499b-a608-c3e9f207137d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:11.683496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9d540eb2-c3b9-499b-a608-c3e9f207137d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:11.683924 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9d540eb2-c3b9-499b-a608-c3e9f207137d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:11.809474 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9d540eb2-c3b9-499b-a608-c3e9f207137d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:11.816685 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9d540eb2-c3b9-499b-a608-c3e9f207137d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1319 microversion: 2.1 time: 0.145686 Aug 24 19:35:11.817249 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 429/872] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:11 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:12.035182 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6be0061f-7863-4576-a52b-41208bc8ef68 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:12.035664 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6be0061f-7863-4576-a52b-41208bc8ef68 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:12.042542 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6be0061f-7863-4576-a52b-41208bc8ef68 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:12.042985 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6be0061f-7863-4576-a52b-41208bc8ef68 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:12.043735 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6be0061f-7863-4576-a52b-41208bc8ef68 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:12.044159 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6be0061f-7863-4576-a52b-41208bc8ef68 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:12.073133 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6be0061f-7863-4576-a52b-41208bc8ef68 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/os-volume_attachments/55068dbe-81a4-4338-94ae-e54f25016c48" status: 200 len: 194 microversion: 2.20 time: 0.154480 Aug 24 19:35:12.073710 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 444/873] 10.222.0.59 () {60 vars in 1454 bytes} [Tue Aug 24 19:35:11 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/os-volume_attachments/55068dbe-81a4-4338-94ae-e54f25016c48 => generated 194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:35:12.140821 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4b4cf410-8cab-483d-9134-8310b420fdee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:12.141336 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4b4cf410-8cab-483d-9134-8310b420fdee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:12.147645 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4b4cf410-8cab-483d-9134-8310b420fdee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:12.148094 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4b4cf410-8cab-483d-9134-8310b420fdee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:12.148914 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4b4cf410-8cab-483d-9134-8310b420fdee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:12.149342 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4b4cf410-8cab-483d-9134-8310b420fdee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:12.234591 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.objects.instance [None req-4b4cf410-8cab-483d-9134-8310b420fdee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lazy-loading 'services' on Instance uuid 7c70c776-ec7a-4970-9d9f-baf8c6568257 {{(pid=108908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:35:12.452728 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7a8f6785-4ef0-4602-bac7-d755ad5b4f36 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:12.453262 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7a8f6785-4ef0-4602-bac7-d755ad5b4f36 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:12.457441 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4b4cf410-8cab-483d-9134-8310b420fdee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/os-volume_attachments/55068dbe-81a4-4338-94ae-e54f25016c48" status: 202 len: 0 microversion: 2.20 time: 0.320310 Aug 24 19:35:12.459232 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 430/874] 10.222.0.59 () {60 vars in 1457 bytes} [Tue Aug 24 19:35:12 2021] DELETE /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/os-volume_attachments/55068dbe-81a4-4338-94ae-e54f25016c48 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:35:12.460335 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a8f6785-4ef0-4602-bac7-d755ad5b4f36 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:12.460780 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a8f6785-4ef0-4602-bac7-d755ad5b4f36 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:12.461542 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a8f6785-4ef0-4602-bac7-d755ad5b4f36 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:12.461968 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a8f6785-4ef0-4602-bac7-d755ad5b4f36 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:12.466710 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f0db063f-9b74-4d78-80c1-7befb018da90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:12.467795 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f0db063f-9b74-4d78-80c1-7befb018da90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:12.474216 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f0db063f-9b74-4d78-80c1-7befb018da90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:12.474665 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f0db063f-9b74-4d78-80c1-7befb018da90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:12.475931 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f0db063f-9b74-4d78-80c1-7befb018da90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:12.476399 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f0db063f-9b74-4d78-80c1-7befb018da90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:12.506497 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f0db063f-9b74-4d78-80c1-7befb018da90 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043674 Aug 24 19:35:12.507405 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 431/875] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 24 19:35:12 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:35:12.573247 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7a8f6785-4ef0-4602-bac7-d755ad5b4f36 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:12.581933 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7a8f6785-4ef0-4602-bac7-d755ad5b4f36 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1289 microversion: 2.1 time: 0.132407 Aug 24 19:35:12.582054 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 445/876] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:12 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1289 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:35:12.833219 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-afee77d1-f8d3-45d3-91bd-d53bbf5e3eb8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:12.833819 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-afee77d1-f8d3-45d3-91bd-d53bbf5e3eb8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:12.840053 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-afee77d1-f8d3-45d3-91bd-d53bbf5e3eb8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:12.840536 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-afee77d1-f8d3-45d3-91bd-d53bbf5e3eb8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:12.841298 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-afee77d1-f8d3-45d3-91bd-d53bbf5e3eb8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:12.841726 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-afee77d1-f8d3-45d3-91bd-d53bbf5e3eb8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:12.961420 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-afee77d1-f8d3-45d3-91bd-d53bbf5e3eb8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:12.968859 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-afee77d1-f8d3-45d3-91bd-d53bbf5e3eb8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1319 microversion: 2.1 time: 0.139356 Aug 24 19:35:12.969873 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 432/877] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:12 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1319 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:13.518730 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b3a90690-af77-44a0-b575-3d9a837b9a5c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:13.519708 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b3a90690-af77-44a0-b575-3d9a837b9a5c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:13.526643 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3a90690-af77-44a0-b575-3d9a837b9a5c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:13.527083 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3a90690-af77-44a0-b575-3d9a837b9a5c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:13.527855 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3a90690-af77-44a0-b575-3d9a837b9a5c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:13.528309 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3a90690-af77-44a0-b575-3d9a837b9a5c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:13.559894 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b3a90690-af77-44a0-b575-3d9a837b9a5c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044852 Aug 24 19:35:13.560851 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 446/878] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 24 19:35:13 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:35:13.598957 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-76e76d67-f9c2-41b1-abf0-1a42615e4861 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:13.599553 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-76e76d67-f9c2-41b1-abf0-1a42615e4861 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:13.606747 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-76e76d67-f9c2-41b1-abf0-1a42615e4861 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:13.607380 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-76e76d67-f9c2-41b1-abf0-1a42615e4861 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:13.608350 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-76e76d67-f9c2-41b1-abf0-1a42615e4861 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:13.608975 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-76e76d67-f9c2-41b1-abf0-1a42615e4861 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:13.670391 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-76e76d67-f9c2-41b1-abf0-1a42615e4861 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:13.682592 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-76e76d67-f9c2-41b1-abf0-1a42615e4861 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1295 microversion: 2.1 time: 0.083539 Aug 24 19:35:13.682592 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 433/879] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:13 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:13.986289 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7ba97532-fe50-4de0-835c-5543e0a7c01b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:13.988096 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7ba97532-fe50-4de0-835c-5543e0a7c01b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:13.995696 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7ba97532-fe50-4de0-835c-5543e0a7c01b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:13.996146 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7ba97532-fe50-4de0-835c-5543e0a7c01b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:13.997156 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7ba97532-fe50-4de0-835c-5543e0a7c01b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:13.997753 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7ba97532-fe50-4de0-835c-5543e0a7c01b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:14.138034 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7ba97532-fe50-4de0-835c-5543e0a7c01b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:14.145500 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7ba97532-fe50-4de0-835c-5543e0a7c01b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1319 microversion: 2.1 time: 0.162828 Aug 24 19:35:14.146194 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 447/880] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:13 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:14.571755 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e3ec5751-c09b-409e-b64b-edc8d5a7addf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:14.572710 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e3ec5751-c09b-409e-b64b-edc8d5a7addf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:14.578498 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3ec5751-c09b-409e-b64b-edc8d5a7addf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:14.578937 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3ec5751-c09b-409e-b64b-edc8d5a7addf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:14.579697 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3ec5751-c09b-409e-b64b-edc8d5a7addf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:14.580124 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e3ec5751-c09b-409e-b64b-edc8d5a7addf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:14.608004 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e3ec5751-c09b-409e-b64b-edc8d5a7addf tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040291 Aug 24 19:35:14.608593 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 434/881] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 24 19:35:14 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:14.682463 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-93bd311c-9503-45a3-a950-f7430dbc3667 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:14.682974 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-93bd311c-9503-45a3-a950-f7430dbc3667 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:14.693612 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-93bd311c-9503-45a3-a950-f7430dbc3667 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:14.694119 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-93bd311c-9503-45a3-a950-f7430dbc3667 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:14.694823 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-26ba5290-0fe9-416e-aea6-ebad5ddc970a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:14.695436 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-26ba5290-0fe9-416e-aea6-ebad5ddc970a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:14.698818 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-93bd311c-9503-45a3-a950-f7430dbc3667 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:14.699293 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-93bd311c-9503-45a3-a950-f7430dbc3667 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:14.705551 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-26ba5290-0fe9-416e-aea6-ebad5ddc970a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:14.705905 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-26ba5290-0fe9-416e-aea6-ebad5ddc970a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:14.713571 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-26ba5290-0fe9-416e-aea6-ebad5ddc970a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:14.715761 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-26ba5290-0fe9-416e-aea6-ebad5ddc970a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:14.757648 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-93bd311c-9503-45a3-a950-f7430dbc3667 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Going to try to terminate instance {{(pid=108907) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:35:14.943857 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-26ba5290-0fe9-416e-aea6-ebad5ddc970a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:14.952341 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-26ba5290-0fe9-416e-aea6-ebad5ddc970a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1363 microversion: 2.1 time: 0.261060 Aug 24 19:35:14.953113 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 435/882] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:14 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1363 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:35:15.108966 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-a5b16920-a3e8-44f4-9895-98ab381c28c0 req-d34d1b3b-1580-4f2c-bb1f-fb2d21b593a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86c2b9c-45eb-40fe-a846-982db14d42cd", "tag": "bd28ff14-2c6c-49d2-a836-10efaf8f9f5c"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:15.110946 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:35:15.110946 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:35:15.118660 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-a5b16920-a3e8-44f4-9895-98ab381c28c0 req-d34d1b3b-1580-4f2c-bb1f-fb2d21b593a9 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:15.119106 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-a5b16920-a3e8-44f4-9895-98ab381c28c0 req-d34d1b3b-1580-4f2c-bb1f-fb2d21b593a9 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:15.133551 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-a5b16920-a3e8-44f4-9895-98ab381c28c0 req-d34d1b3b-1580-4f2c-bb1f-fb2d21b593a9 service nova] Creating event network-changed:bd28ff14-2c6c-49d2-a836-10efaf8f9f5c for instance f86c2b9c-45eb-40fe-a846-982db14d42cd on hv-cinder-79819 Aug 24 19:35:15.137534 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-93bd311c-9503-45a3-a950-f7430dbc3667 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 204 len: 0 microversion: 2.20 time: 0.459455 Aug 24 19:35:15.138300 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 448/883] 10.222.0.59 () {60 vars in 1280 bytes} [Tue Aug 24 19:35:14 2021] DELETE /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 24 19:35:15.140431 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-a5b16920-a3e8-44f4-9895-98ab381c28c0 req-d34d1b3b-1580-4f2c-bb1f-fb2d21b593a9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035577 Aug 24 19:35:15.140431 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 436/884] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:35:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:35:15.148237 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-3e5dcd32-f501-4812-990c-02f719c21564 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:15.148955 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3e5dcd32-f501-4812-990c-02f719c21564 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:15.155832 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3e5dcd32-f501-4812-990c-02f719c21564 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:15.156407 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3e5dcd32-f501-4812-990c-02f719c21564 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:15.157299 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3e5dcd32-f501-4812-990c-02f719c21564 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:15.157912 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3e5dcd32-f501-4812-990c-02f719c21564 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:15.163840 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-35ac49f1-33f3-4caf-808a-c3a3e4e1d463 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:15.164731 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-35ac49f1-33f3-4caf-808a-c3a3e4e1d463 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:15.171468 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-35ac49f1-33f3-4caf-808a-c3a3e4e1d463 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:15.171925 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-35ac49f1-33f3-4caf-808a-c3a3e4e1d463 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:15.172748 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-35ac49f1-33f3-4caf-808a-c3a3e4e1d463 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:15.173188 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-35ac49f1-33f3-4caf-808a-c3a3e4e1d463 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:15.372023 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-35ac49f1-33f3-4caf-808a-c3a3e4e1d463 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:15.380012 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-35ac49f1-33f3-4caf-808a-c3a3e4e1d463 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1319 microversion: 2.1 time: 0.220603 Aug 24 19:35:15.382856 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 437/885] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:15 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:15.387157 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3e5dcd32-f501-4812-990c-02f719c21564 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:15.400456 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3e5dcd32-f501-4812-990c-02f719c21564 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:15.402097 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3e5dcd32-f501-4812-990c-02f719c21564 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:15.403488 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-3e5dcd32-f501-4812-990c-02f719c21564 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.259718 Aug 24 19:35:15.404241 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 449/886] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:15 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:35:15.969770 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e15bda62-6906-4391-92a6-e7fe6326beeb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:15.970365 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e15bda62-6906-4391-92a6-e7fe6326beeb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:15.977004 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e15bda62-6906-4391-92a6-e7fe6326beeb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:15.977444 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e15bda62-6906-4391-92a6-e7fe6326beeb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:15.981677 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e15bda62-6906-4391-92a6-e7fe6326beeb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:15.981677 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e15bda62-6906-4391-92a6-e7fe6326beeb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:16.096035 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e15bda62-6906-4391-92a6-e7fe6326beeb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:16.103898 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e15bda62-6906-4391-92a6-e7fe6326beeb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1363 microversion: 2.1 time: 0.137774 Aug 24 19:35:16.104496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 438/887] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:15 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1363 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:16.296939 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-fc55414b-623c-4054-916a-28d376e5d1db req-102ffbd8-a80c-4ae8-91f8-b07a80c1ba78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "912de8e3-51dc-4fa5-89fd-b59b6c4ef269", "name": "network-vif-plugged", "status": "completed", "tag": "e94ceb52-3b3d-42f2-9e6b-4283c1fbbb3d"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:16.298518 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:35:16.298518 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:35:16.305252 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-fc55414b-623c-4054-916a-28d376e5d1db req-102ffbd8-a80c-4ae8-91f8-b07a80c1ba78 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:16.305625 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-fc55414b-623c-4054-916a-28d376e5d1db req-102ffbd8-a80c-4ae8-91f8-b07a80c1ba78 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:16.316415 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-fc55414b-623c-4054-916a-28d376e5d1db req-102ffbd8-a80c-4ae8-91f8-b07a80c1ba78 service nova] Creating event network-vif-plugged:e94ceb52-3b3d-42f2-9e6b-4283c1fbbb3d for instance 912de8e3-51dc-4fa5-89fd-b59b6c4ef269 on hv-cinder-79819 Aug 24 19:35:16.321189 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-fc55414b-623c-4054-916a-28d376e5d1db req-102ffbd8-a80c-4ae8-91f8-b07a80c1ba78 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027891 Aug 24 19:35:16.321767 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 450/888] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:35:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:35:16.398285 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9c3ccbc8-dd21-46ad-a1e5-2ab04c04f49f tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:16.398884 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9c3ccbc8-dd21-46ad-a1e5-2ab04c04f49f tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:16.404946 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9c3ccbc8-dd21-46ad-a1e5-2ab04c04f49f tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:16.405381 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9c3ccbc8-dd21-46ad-a1e5-2ab04c04f49f tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:16.406173 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9c3ccbc8-dd21-46ad-a1e5-2ab04c04f49f tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:16.406641 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9c3ccbc8-dd21-46ad-a1e5-2ab04c04f49f tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:16.426638 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8dcb7da1-3845-4bad-a0d2-bcc205ea0dae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:16.427348 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8dcb7da1-3845-4bad-a0d2-bcc205ea0dae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:16.433671 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8dcb7da1-3845-4bad-a0d2-bcc205ea0dae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:16.434702 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8dcb7da1-3845-4bad-a0d2-bcc205ea0dae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:16.435559 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8dcb7da1-3845-4bad-a0d2-bcc205ea0dae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:16.435991 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8dcb7da1-3845-4bad-a0d2-bcc205ea0dae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:16.593981 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9c3ccbc8-dd21-46ad-a1e5-2ab04c04f49f tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:16.602590 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9c3ccbc8-dd21-46ad-a1e5-2ab04c04f49f tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1319 microversion: 2.1 time: 0.208364 Aug 24 19:35:16.603203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 439/889] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:16 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:16.603919 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8dcb7da1-3845-4bad-a0d2-bcc205ea0dae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:16.624973 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8dcb7da1-3845-4bad-a0d2-bcc205ea0dae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:16.626437 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8dcb7da1-3845-4bad-a0d2-bcc205ea0dae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:16.627561 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8dcb7da1-3845-4bad-a0d2-bcc205ea0dae tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.205017 Aug 24 19:35:16.628118 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 451/890] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:16 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:35:17.121026 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-39839669-b9e1-4447-9392-a80732605a66 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:17.121637 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-39839669-b9e1-4447-9392-a80732605a66 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:17.127747 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-39839669-b9e1-4447-9392-a80732605a66 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:17.128199 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-39839669-b9e1-4447-9392-a80732605a66 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:17.129007 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-39839669-b9e1-4447-9392-a80732605a66 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:17.129440 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-39839669-b9e1-4447-9392-a80732605a66 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:17.252826 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-39839669-b9e1-4447-9392-a80732605a66 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:17.260980 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-39839669-b9e1-4447-9392-a80732605a66 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1363 microversion: 2.1 time: 0.143467 Aug 24 19:35:17.261875 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 440/891] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:17 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:17.622143 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5fc97f28-6a45-46e7-b58f-f4614631ebce tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:17.622841 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5fc97f28-6a45-46e7-b58f-f4614631ebce tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:17.628540 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5fc97f28-6a45-46e7-b58f-f4614631ebce tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:17.628976 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5fc97f28-6a45-46e7-b58f-f4614631ebce tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:17.629728 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5fc97f28-6a45-46e7-b58f-f4614631ebce tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:17.630152 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5fc97f28-6a45-46e7-b58f-f4614631ebce tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:17.649388 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-86ce3d18-4e4e-484b-974e-fb5780996987 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:17.649388 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-86ce3d18-4e4e-484b-974e-fb5780996987 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:17.653871 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-86ce3d18-4e4e-484b-974e-fb5780996987 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:17.660204 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-86ce3d18-4e4e-484b-974e-fb5780996987 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:17.672099 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-86ce3d18-4e4e-484b-974e-fb5780996987 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:17.672742 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-86ce3d18-4e4e-484b-974e-fb5780996987 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:17.792666 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5fc97f28-6a45-46e7-b58f-f4614631ebce tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:17.800925 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5fc97f28-6a45-46e7-b58f-f4614631ebce tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1319 microversion: 2.1 time: 0.182558 Aug 24 19:35:17.802196 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 452/892] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:17 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:17.829076 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-86ce3d18-4e4e-484b-974e-fb5780996987 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:17.838718 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-86ce3d18-4e4e-484b-974e-fb5780996987 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:17.840520 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-86ce3d18-4e4e-484b-974e-fb5780996987 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:17.841679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-86ce3d18-4e4e-484b-974e-fb5780996987 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1722 microversion: 2.20 time: 0.199073 Aug 24 19:35:17.842237 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 441/893] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:17 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:35:18.101977 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-f7f958a9-171b-4b84-a85b-5532c4190857 req-a5a32724-7ba8-4921-a08b-47c98a7a516a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c70c776-ec7a-4970-9d9f-baf8c6568257", "name": "network-vif-deleted", "tag": "39906ad8-eb91-4f23-8e1c-cbdd3d7aa570"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:18.103487 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:35:18.103487 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:35:18.110320 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-f7f958a9-171b-4b84-a85b-5532c4190857 req-a5a32724-7ba8-4921-a08b-47c98a7a516a service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:18.110689 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-f7f958a9-171b-4b84-a85b-5532c4190857 req-a5a32724-7ba8-4921-a08b-47c98a7a516a service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:18.121899 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-f7f958a9-171b-4b84-a85b-5532c4190857 req-a5a32724-7ba8-4921-a08b-47c98a7a516a service nova] Creating event network-vif-deleted:39906ad8-eb91-4f23-8e1c-cbdd3d7aa570 for instance 7c70c776-ec7a-4970-9d9f-baf8c6568257 on hv-cinder-79819 Aug 24 19:35:18.126752 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-f7f958a9-171b-4b84-a85b-5532c4190857 req-a5a32724-7ba8-4921-a08b-47c98a7a516a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028980 Aug 24 19:35:18.127344 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 453/894] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:35:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:35:18.278823 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c51e44d0-0e27-4a24-840c-cb0d1e95ac5b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:18.280200 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-c51e44d0-0e27-4a24-840c-cb0d1e95ac5b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:18.286802 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c51e44d0-0e27-4a24-840c-cb0d1e95ac5b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:18.287631 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c51e44d0-0e27-4a24-840c-cb0d1e95ac5b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:18.288524 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c51e44d0-0e27-4a24-840c-cb0d1e95ac5b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:18.289226 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c51e44d0-0e27-4a24-840c-cb0d1e95ac5b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:18.413270 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-c51e44d0-0e27-4a24-840c-cb0d1e95ac5b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:18.420797 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c51e44d0-0e27-4a24-840c-cb0d1e95ac5b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1363 microversion: 2.1 time: 0.146007 Aug 24 19:35:18.421352 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 442/895] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:18 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:18.819734 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-56c98d10-834b-41c4-92df-553368e847c5 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:18.820462 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-56c98d10-834b-41c4-92df-553368e847c5 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:18.826740 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-56c98d10-834b-41c4-92df-553368e847c5 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:18.827181 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-56c98d10-834b-41c4-92df-553368e847c5 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:18.827951 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-56c98d10-834b-41c4-92df-553368e847c5 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:18.828414 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-56c98d10-834b-41c4-92df-553368e847c5 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:18.861076 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ac495b51-506b-43ae-a803-35cdd5250f01 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:18.861683 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ac495b51-506b-43ae-a803-35cdd5250f01 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:18.868112 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ac495b51-506b-43ae-a803-35cdd5250f01 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:18.868583 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ac495b51-506b-43ae-a803-35cdd5250f01 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:18.869364 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ac495b51-506b-43ae-a803-35cdd5250f01 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:18.869791 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ac495b51-506b-43ae-a803-35cdd5250f01 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:18.937933 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ac495b51-506b-43ae-a803-35cdd5250f01 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:18.948255 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ac495b51-506b-43ae-a803-35cdd5250f01 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:18.950982 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ac495b51-506b-43ae-a803-35cdd5250f01 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:18.952169 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ac495b51-506b-43ae-a803-35cdd5250f01 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1654 microversion: 2.20 time: 0.095120 Aug 24 19:35:18.952764 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 443/896] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:18 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1654 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:35:18.998078 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-56c98d10-834b-41c4-92df-553368e847c5 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:19.007240 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-56c98d10-834b-41c4-92df-553368e847c5 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1508 microversion: 2.1 time: 0.192100 Aug 24 19:35:19.008063 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 454/897] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:18 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:19.437938 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a86c62a8-1ee0-43d2-a48f-74e8fcf7474d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:19.438608 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a86c62a8-1ee0-43d2-a48f-74e8fcf7474d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:19.452041 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a86c62a8-1ee0-43d2-a48f-74e8fcf7474d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:19.452041 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a86c62a8-1ee0-43d2-a48f-74e8fcf7474d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:19.452041 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a86c62a8-1ee0-43d2-a48f-74e8fcf7474d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:19.452041 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a86c62a8-1ee0-43d2-a48f-74e8fcf7474d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:19.567718 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a86c62a8-1ee0-43d2-a48f-74e8fcf7474d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:19.575320 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a86c62a8-1ee0-43d2-a48f-74e8fcf7474d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1363 microversion: 2.1 time: 0.140578 Aug 24 19:35:19.575433 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 444/898] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:19 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:19.969843 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a50ad086-1f14-4ad2-a5b7-2f4b46465e35 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:19.970646 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a50ad086-1f14-4ad2-a5b7-2f4b46465e35 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:19.976647 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a50ad086-1f14-4ad2-a5b7-2f4b46465e35 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:19.977082 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a50ad086-1f14-4ad2-a5b7-2f4b46465e35 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:19.977888 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a50ad086-1f14-4ad2-a5b7-2f4b46465e35 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:19.978321 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a50ad086-1f14-4ad2-a5b7-2f4b46465e35 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:20.042022 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a50ad086-1f14-4ad2-a5b7-2f4b46465e35 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:20.049826 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a50ad086-1f14-4ad2-a5b7-2f4b46465e35 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:20.051303 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a50ad086-1f14-4ad2-a5b7-2f4b46465e35 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:20.052964 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a50ad086-1f14-4ad2-a5b7-2f4b46465e35 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1654 microversion: 2.20 time: 0.086447 Aug 24 19:35:20.053518 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 455/899] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:19 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1654 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:35:20.592103 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8365ffd6-6188-4ace-a955-be892e1c42e1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:20.592709 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8365ffd6-6188-4ace-a955-be892e1c42e1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:20.598540 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8365ffd6-6188-4ace-a955-be892e1c42e1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:20.598981 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8365ffd6-6188-4ace-a955-be892e1c42e1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:20.600428 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8365ffd6-6188-4ace-a955-be892e1c42e1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:20.600872 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8365ffd6-6188-4ace-a955-be892e1c42e1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:20.718286 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8365ffd6-6188-4ace-a955-be892e1c42e1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:20.726489 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8365ffd6-6188-4ace-a955-be892e1c42e1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1363 microversion: 2.1 time: 0.137955 Aug 24 19:35:20.727624 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 445/900] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:20 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1363 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:21.073248 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-2205fed2-e337-4207-9705-c424e9cae00f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:21.074748 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-2205fed2-e337-4207-9705-c424e9cae00f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:21.081503 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2205fed2-e337-4207-9705-c424e9cae00f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:21.081942 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2205fed2-e337-4207-9705-c424e9cae00f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:21.082784 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2205fed2-e337-4207-9705-c424e9cae00f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:21.083293 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2205fed2-e337-4207-9705-c424e9cae00f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:21.114682 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2205fed2-e337-4207-9705-c424e9cae00f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:21.115512 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-2205fed2-e337-4207-9705-c424e9cae00f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:21.116038 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-2205fed2-e337-4207-9705-c424e9cae00f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lazy-loading 'fault' on Instance uuid 7c70c776-ec7a-4970-9d9f-baf8c6568257 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:35:21.156796 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2205fed2-e337-4207-9705-c424e9cae00f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:21.166254 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2205fed2-e337-4207-9705-c424e9cae00f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:21.167732 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-2205fed2-e337-4207-9705-c424e9cae00f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:21.168956 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-2205fed2-e337-4207-9705-c424e9cae00f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 200 len: 1370 microversion: 2.20 time: 0.101037 Aug 24 19:35:21.169504 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 456/901] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:21 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 1370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:35:21.743293 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-de879952-9bfa-4fbb-b59c-9f1cda0d3f1c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:21.743903 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-de879952-9bfa-4fbb-b59c-9f1cda0d3f1c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:21.749752 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-de879952-9bfa-4fbb-b59c-9f1cda0d3f1c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:21.750313 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-de879952-9bfa-4fbb-b59c-9f1cda0d3f1c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:21.753169 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-de879952-9bfa-4fbb-b59c-9f1cda0d3f1c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:21.753169 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-de879952-9bfa-4fbb-b59c-9f1cda0d3f1c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:21.878869 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-de879952-9bfa-4fbb-b59c-9f1cda0d3f1c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:21.886787 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-de879952-9bfa-4fbb-b59c-9f1cda0d3f1c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1363 microversion: 2.1 time: 0.147198 Aug 24 19:35:21.887358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 446/902] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:21 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:22.187345 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-38dae514-4ef3-467f-bb2c-dbd9b2d1f577 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:22.188004 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-38dae514-4ef3-467f-bb2c-dbd9b2d1f577 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:22.194605 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-38dae514-4ef3-467f-bb2c-dbd9b2d1f577 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:22.195048 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-38dae514-4ef3-467f-bb2c-dbd9b2d1f577 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:22.195817 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-38dae514-4ef3-467f-bb2c-dbd9b2d1f577 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:22.196247 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-38dae514-4ef3-467f-bb2c-dbd9b2d1f577 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:22.209870 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-38dae514-4ef3-467f-bb2c-dbd9b2d1f577 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] HTTP exception thrown: Instance 7c70c776-ec7a-4970-9d9f-baf8c6568257 could not be found. Aug 24 19:35:22.210484 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-38dae514-4ef3-467f-bb2c-dbd9b2d1f577 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Returning 404 to user: Instance 7c70c776-ec7a-4970-9d9f-baf8c6568257 could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:35:22.211374 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-38dae514-4ef3-467f-bb2c-dbd9b2d1f577 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 404 len: 111 microversion: 2.20 time: 0.028291 Aug 24 19:35:22.211902 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 457/903] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:22 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 19:35:22.220177 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ae998a88-8a34-4df3-8095-b1c3e7c7d714 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '.version_select at 0x7f8df74685e0>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:22.395118 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ae998a88-8a34-4df3-8095-b1c3e7c7d714 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-914740205" status: 204 len: 0 microversion: 2.20 time: 0.178549 Aug 24 19:35:22.395702 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 447/904] 10.222.0.59 () {60 vars in 1259 bytes} [Tue Aug 24 19:35:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-914740205 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 19:35:22.905060 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-757167b7-812d-4a35-b8c8-d9f09ad974da tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:22.905665 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-757167b7-812d-4a35-b8c8-d9f09ad974da tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:22.913386 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-757167b7-812d-4a35-b8c8-d9f09ad974da tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:22.913386 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-757167b7-812d-4a35-b8c8-d9f09ad974da tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:22.914079 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-757167b7-812d-4a35-b8c8-d9f09ad974da tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:22.914686 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-757167b7-812d-4a35-b8c8-d9f09ad974da tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:23.081952 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-757167b7-812d-4a35-b8c8-d9f09ad974da tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:23.090381 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-757167b7-812d-4a35-b8c8-d9f09ad974da tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1363 microversion: 2.1 time: 0.189628 Aug 24 19:35:23.090947 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 458/905] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:22 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:23.103579 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-2942cc8b-e5ce-4e33-b50a-6cf58dacf4df req-8b22ec60-1560-4cdc-8d53-0a396f70f224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86c2b9c-45eb-40fe-a846-982db14d42cd", "name": "network-vif-plugged", "status": "completed", "tag": "bd28ff14-2c6c-49d2-a836-10efaf8f9f5c"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:23.105099 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:35:23.105099 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:35:23.111810 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-2942cc8b-e5ce-4e33-b50a-6cf58dacf4df req-8b22ec60-1560-4cdc-8d53-0a396f70f224 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:23.112241 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-2942cc8b-e5ce-4e33-b50a-6cf58dacf4df req-8b22ec60-1560-4cdc-8d53-0a396f70f224 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:23.123004 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-2942cc8b-e5ce-4e33-b50a-6cf58dacf4df req-8b22ec60-1560-4cdc-8d53-0a396f70f224 service nova] Creating event network-vif-plugged:bd28ff14-2c6c-49d2-a836-10efaf8f9f5c for instance f86c2b9c-45eb-40fe-a846-982db14d42cd on hv-cinder-79819 Aug 24 19:35:23.129886 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-2942cc8b-e5ce-4e33-b50a-6cf58dacf4df req-8b22ec60-1560-4cdc-8d53-0a396f70f224 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028379 Aug 24 19:35:23.129886 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 448/906] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:35:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:35:23.365016 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-16de8a59-a112-46da-8293-d884b4490da4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'create', calling method: .version_select at 0x7f8df758cca0>, body: {"keypair": {"name": "tempest-keypair-1181257249"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:23.382633 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-16de8a59-a112-46da-8293-d884b4490da4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Getting quotas for project 06ad67d05efc48a180df2740ce5dedba. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:35:23.386343 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-16de8a59-a112-46da-8293-d884b4490da4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Getting quotas for user 8ac543b87ad24d2f97a6101885753717 and project 06ad67d05efc48a180df2740ce5dedba. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:35:23.830764 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-16de8a59-a112-46da-8293-d884b4490da4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Getting quotas for project 06ad67d05efc48a180df2740ce5dedba. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:35:23.834318 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-16de8a59-a112-46da-8293-d884b4490da4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Getting quotas for user 8ac543b87ad24d2f97a6101885753717 and project 06ad67d05efc48a180df2740ce5dedba. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:35:23.847314 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-16de8a59-a112-46da-8293-d884b4490da4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.486166 Aug 24 19:35:23.850344 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 459/907] 10.222.0.59 () {62 vars in 1199 bytes} [Tue Aug 24 19:35:23 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 487 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 24 19:35:24.107598 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-bad590c1-61f3-4d4b-bcb7-9f09b9463f83 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:24.108184 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-bad590c1-61f3-4d4b-bcb7-9f09b9463f83 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:24.120290 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bad590c1-61f3-4d4b-bcb7-9f09b9463f83 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:24.120738 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bad590c1-61f3-4d4b-bcb7-9f09b9463f83 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:24.121495 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bad590c1-61f3-4d4b-bcb7-9f09b9463f83 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:24.121923 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bad590c1-61f3-4d4b-bcb7-9f09b9463f83 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:24.269312 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-bad590c1-61f3-4d4b-bcb7-9f09b9463f83 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:24.277159 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-bad590c1-61f3-4d4b-bcb7-9f09b9463f83 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1363 microversion: 2.1 time: 0.173654 Aug 24 19:35:24.278226 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 449/908] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:24 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:25.295308 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-900566e5-e86f-4d36-9490-ab4b0996508e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:25.295936 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-900566e5-e86f-4d36-9490-ab4b0996508e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:25.302428 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-900566e5-e86f-4d36-9490-ab4b0996508e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:25.302929 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-900566e5-e86f-4d36-9490-ab4b0996508e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:25.303696 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-900566e5-e86f-4d36-9490-ab4b0996508e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:25.304130 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-900566e5-e86f-4d36-9490-ab4b0996508e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:25.427312 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-900566e5-e86f-4d36-9490-ab4b0996508e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:25.434812 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-900566e5-e86f-4d36-9490-ab4b0996508e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1549 microversion: 2.1 time: 0.143268 Aug 24 19:35:25.435472 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 460/909] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:25 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1549 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:25.452615 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a6e608e5-3083-4204-840d-9f17b9901f08 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:25.453182 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a6e608e5-3083-4204-840d-9f17b9901f08 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:25.459099 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6e608e5-3083-4204-840d-9f17b9901f08 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:25.459692 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6e608e5-3083-4204-840d-9f17b9901f08 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:25.460502 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6e608e5-3083-4204-840d-9f17b9901f08 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:25.460950 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a6e608e5-3083-4204-840d-9f17b9901f08 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:25.540684 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a6e608e5-3083-4204-840d-9f17b9901f08 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092009 Aug 24 19:35:25.541315 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 450/910] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Aug 24 19:35:25 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:35:26.383258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1289956827", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a5ad5e3-9c10-4546-ad12-dff1390a5197"}], "security_groups": [{"name": "tempest-securitygroup--908414633"}], "key_name": "tempest-keypair-1181257249", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:26.497707 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.network.neutron [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] validate_networks() for [('0a5ad5e3-9c10-4546-ad12-dff1390a5197', None, None, None, None, None)] {{(pid=108907) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:35:26.758002 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-bb52e138-adfc-43fb-9b12-660e2df14779 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:26.758919 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-bb52e138-adfc-43fb-9b12-660e2df14779 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:26.768823 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bb52e138-adfc-43fb-9b12-660e2df14779 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:26.768823 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bb52e138-adfc-43fb-9b12-660e2df14779 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:26.768823 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bb52e138-adfc-43fb-9b12-660e2df14779 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:26.769569 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-bb52e138-adfc-43fb-9b12-660e2df14779 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:26.849124 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-bb52e138-adfc-43fb-9b12-660e2df14779 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 14 microversion: 2.1 time: 0.094852 Aug 24 19:35:26.850291 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 451/911] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:26 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 19:35:26.855827 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-9f340b73-2788-49fd-ad16-202aebce1c99 req-7f5b22ca-da9e-472d-b136-ebb2dc8c0d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86c2b9c-45eb-40fe-a846-982db14d42cd", "tag": "bd28ff14-2c6c-49d2-a836-10efaf8f9f5c"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:26.857556 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:35:26.857556 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:35:26.866243 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-9f340b73-2788-49fd-ad16-202aebce1c99 req-7f5b22ca-da9e-472d-b136-ebb2dc8c0d1e service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:26.868779 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-9f340b73-2788-49fd-ad16-202aebce1c99 req-7f5b22ca-da9e-472d-b136-ebb2dc8c0d1e service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:26.880838 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-9f340b73-2788-49fd-ad16-202aebce1c99 req-7f5b22ca-da9e-472d-b136-ebb2dc8c0d1e service nova] Creating event network-changed:bd28ff14-2c6c-49d2-a836-10efaf8f9f5c for instance f86c2b9c-45eb-40fe-a846-982db14d42cd on hv-cinder-79819 Aug 24 19:35:26.886127 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-9f340b73-2788-49fd-ad16-202aebce1c99 req-7f5b22ca-da9e-472d-b136-ebb2dc8c0d1e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034244 Aug 24 19:35:26.887203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 452/912] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:35:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:35:27.067739 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Flavor limits 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:35:27.068290 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Image limits 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:35:27.068865 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Flavor pref 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:35:27.069366 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Image pref 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:35:27.069833 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:35:27.084719 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:27.085527 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:27.086541 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:27.087187 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:27.106613 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Getting quotas for project 06ad67d05efc48a180df2740ce5dedba. Resources: {'cores', 'ram', 'instances'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:35:27.118801 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Getting quotas for user 8ac543b87ad24d2f97a6101885753717 and project 06ad67d05efc48a180df2740ce5dedba. Resources: {'cores', 'ram', 'instances'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:35:27.134714 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Going to run 1 instances... {{(pid=108907) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:35:27.137237 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:35:27.459042 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-74b55d72-5027-4eab-9a37-764fc453eefe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.080154 Aug 24 19:35:27.459978 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 461/913] 10.222.0.59 () {62 vars in 1188 bytes} [Tue Aug 24 19:35:26 2021] POST /compute/v2.1/servers => generated 401 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 19:35:27.474484 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-67ee0eab-0d12-4b2d-b7a4-bd76e2a7e97c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:27.480650 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-67ee0eab-0d12-4b2d-b7a4-bd76e2a7e97c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:27.565893 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-67ee0eab-0d12-4b2d-b7a4-bd76e2a7e97c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:27.574730 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-67ee0eab-0d12-4b2d-b7a4-bd76e2a7e97c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:27.576654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-67ee0eab-0d12-4b2d-b7a4-bd76e2a7e97c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:27.578169 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-67ee0eab-0d12-4b2d-b7a4-bd76e2a7e97c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1282 microversion: 2.20 time: 0.111161 Aug 24 19:35:27.589630 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 453/914] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:27 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1282 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:35:27.861459 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f0501b86-2399-4600-b964-29c135472239 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:27.867313 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f0501b86-2399-4600-b964-29c135472239 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:27.868807 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0501b86-2399-4600-b964-29c135472239 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:27.869256 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0501b86-2399-4600-b964-29c135472239 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:27.870733 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0501b86-2399-4600-b964-29c135472239 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:27.871117 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f0501b86-2399-4600-b964-29c135472239 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:27.943120 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f0501b86-2399-4600-b964-29c135472239 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 14 microversion: 2.1 time: 0.085917 Aug 24 19:35:27.944295 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 462/915] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:27 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:35:28.595694 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8b37e39a-15ff-437e-9606-2b99d4888a83 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:28.596323 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8b37e39a-15ff-437e-9606-2b99d4888a83 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:28.604818 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8b37e39a-15ff-437e-9606-2b99d4888a83 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:28.604818 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8b37e39a-15ff-437e-9606-2b99d4888a83 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:28.605133 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8b37e39a-15ff-437e-9606-2b99d4888a83 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:28.605529 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8b37e39a-15ff-437e-9606-2b99d4888a83 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:28.916503 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8b37e39a-15ff-437e-9606-2b99d4888a83 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:28.924591 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8b37e39a-15ff-437e-9606-2b99d4888a83 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:28.926014 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8b37e39a-15ff-437e-9606-2b99d4888a83 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:28.927145 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8b37e39a-15ff-437e-9606-2b99d4888a83 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1286 microversion: 2.20 time: 0.335087 Aug 24 19:35:28.927949 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 454/916] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:28 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1286 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:35:28.960997 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e41dfc8c-aa79-4a84-b8e6-bb1ae31f888c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:28.962531 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e41dfc8c-aa79-4a84-b8e6-bb1ae31f888c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:28.969546 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e41dfc8c-aa79-4a84-b8e6-bb1ae31f888c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:28.969992 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e41dfc8c-aa79-4a84-b8e6-bb1ae31f888c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:28.970777 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e41dfc8c-aa79-4a84-b8e6-bb1ae31f888c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:28.971201 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e41dfc8c-aa79-4a84-b8e6-bb1ae31f888c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:29.037986 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e41dfc8c-aa79-4a84-b8e6-bb1ae31f888c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 14 microversion: 2.1 time: 0.087064 Aug 24 19:35:29.038667 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 463/917] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:28 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:35:29.945628 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-64f6d537-d120-48ff-b08e-ee9b88c4ab37 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:29.946247 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-64f6d537-d120-48ff-b08e-ee9b88c4ab37 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:29.952050 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-64f6d537-d120-48ff-b08e-ee9b88c4ab37 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:29.952539 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-64f6d537-d120-48ff-b08e-ee9b88c4ab37 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:29.953341 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-64f6d537-d120-48ff-b08e-ee9b88c4ab37 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:29.953764 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-64f6d537-d120-48ff-b08e-ee9b88c4ab37 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:30.016259 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-64f6d537-d120-48ff-b08e-ee9b88c4ab37 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:30.026541 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-64f6d537-d120-48ff-b08e-ee9b88c4ab37 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:30.028524 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-64f6d537-d120-48ff-b08e-ee9b88c4ab37 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:30.029627 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-64f6d537-d120-48ff-b08e-ee9b88c4ab37 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1342 microversion: 2.20 time: 0.088269 Aug 24 19:35:30.040237 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 455/918] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:29 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1342 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:35:30.049479 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a3d670ba-f588-4842-97cb-292b666cc126 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:30.050759 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a3d670ba-f588-4842-97cb-292b666cc126 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:30.057213 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a3d670ba-f588-4842-97cb-292b666cc126 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:30.057654 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a3d670ba-f588-4842-97cb-292b666cc126 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:30.058718 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a3d670ba-f588-4842-97cb-292b666cc126 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:30.059198 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a3d670ba-f588-4842-97cb-292b666cc126 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:30.129985 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a3d670ba-f588-4842-97cb-292b666cc126 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 14 microversion: 2.1 time: 0.083854 Aug 24 19:35:30.130660 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 464/919] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:30 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:35:31.046970 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a2a626a1-f852-4cd6-9b7d-1e0a9082425a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:31.047659 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a2a626a1-f852-4cd6-9b7d-1e0a9082425a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:31.054628 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a2a626a1-f852-4cd6-9b7d-1e0a9082425a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:31.055014 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a2a626a1-f852-4cd6-9b7d-1e0a9082425a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:31.055775 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a2a626a1-f852-4cd6-9b7d-1e0a9082425a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:31.056212 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a2a626a1-f852-4cd6-9b7d-1e0a9082425a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:31.148711 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-008a71fd-fc19-4268-bfef-c3c180fb4745 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:31.148711 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-008a71fd-fc19-4268-bfef-c3c180fb4745 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:31.156613 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-008a71fd-fc19-4268-bfef-c3c180fb4745 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:31.157079 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-008a71fd-fc19-4268-bfef-c3c180fb4745 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:31.163882 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-008a71fd-fc19-4268-bfef-c3c180fb4745 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:31.164380 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-008a71fd-fc19-4268-bfef-c3c180fb4745 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:31.194469 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a2a626a1-f852-4cd6-9b7d-1e0a9082425a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:31.206981 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a2a626a1-f852-4cd6-9b7d-1e0a9082425a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:31.209223 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a2a626a1-f852-4cd6-9b7d-1e0a9082425a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:31.210591 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a2a626a1-f852-4cd6-9b7d-1e0a9082425a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1407 microversion: 2.20 time: 0.167514 Aug 24 19:35:31.211485 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 456/920] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:31 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:35:31.242694 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-008a71fd-fc19-4268-bfef-c3c180fb4745 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 14 microversion: 2.1 time: 0.104700 Aug 24 19:35:31.243348 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 465/921] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:31 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:35:31.462838 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1144449278", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:31.489512 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-4f2dceb5-0337-4aa0-9641-d6669d617e4e req-c4e0a655-7851-4f12-b905-a9b740db040f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df7c8a14-baa7-4787-b6dd-21860c419bda", "tag": "bdbbbe75-74f7-4905-ad5d-1fc34d1d189b"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:31.490913 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:35:31.490913 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:35:31.498985 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-4f2dceb5-0337-4aa0-9641-d6669d617e4e req-c4e0a655-7851-4f12-b905-a9b740db040f service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:31.498985 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-4f2dceb5-0337-4aa0-9641-d6669d617e4e req-c4e0a655-7851-4f12-b905-a9b740db040f service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:31.518437 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-4f2dceb5-0337-4aa0-9641-d6669d617e4e req-c4e0a655-7851-4f12-b905-a9b740db040f service nova] Creating event network-changed:bdbbbe75-74f7-4905-ad5d-1fc34d1d189b for instance df7c8a14-baa7-4787-b6dd-21860c419bda on hv-cinder-79819 Aug 24 19:35:31.523562 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-4f2dceb5-0337-4aa0-9641-d6669d617e4e req-c4e0a655-7851-4f12-b905-a9b740db040f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038581 Aug 24 19:35:31.524159 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 466/922] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:35:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:35:31.534195 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.network.neutron [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] validate_networks() for None {{(pid=108908) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:35:31.834946 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Flavor limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:35:31.835420 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Image limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:35:31.835906 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Flavor pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:35:31.836513 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Image pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:35:31.836946 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:35:31.846232 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:31.846675 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:31.847477 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:31.848559 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:31.864703 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Getting quotas for project e5078624c8df4bc3a3be81135112b9c8. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:35:31.869959 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Getting quotas for user bee3377ff65647fb9ec50fbba32d2db4 and project e5078624c8df4bc3a3be81135112b9c8. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:35:31.881080 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Going to run 1 instances... {{(pid=108908) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:35:31.883465 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:35:32.125876 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e19fd233-3a66-48d7-8526-23c6dbf0a545 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.666807 Aug 24 19:35:32.130173 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 457/923] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:35:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:35:32.140173 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-186c8f10-f350-470b-8bc8-9868cc9b48e5 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:32.140952 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-186c8f10-f350-470b-8bc8-9868cc9b48e5 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:32.199961 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-186c8f10-f350-470b-8bc8-9868cc9b48e5 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:32.211343 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-186c8f10-f350-470b-8bc8-9868cc9b48e5 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1215 microversion: 2.1 time: 0.074920 Aug 24 19:35:32.211928 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 467/924] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:32 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1215 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:32.233400 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a04bd5a9-3da2-417a-8aed-9dddbd5a5105 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:32.234120 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a04bd5a9-3da2-417a-8aed-9dddbd5a5105 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:32.240598 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a04bd5a9-3da2-417a-8aed-9dddbd5a5105 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:32.241719 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a04bd5a9-3da2-417a-8aed-9dddbd5a5105 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:32.242136 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a04bd5a9-3da2-417a-8aed-9dddbd5a5105 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:32.242679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a04bd5a9-3da2-417a-8aed-9dddbd5a5105 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:32.259878 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-bef92d19-8432-4089-9329-6f032c472bad tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:32.260830 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-bef92d19-8432-4089-9329-6f032c472bad tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:32.268826 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bef92d19-8432-4089-9329-6f032c472bad tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:32.269306 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bef92d19-8432-4089-9329-6f032c472bad tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:32.270688 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bef92d19-8432-4089-9329-6f032c472bad tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:32.271053 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bef92d19-8432-4089-9329-6f032c472bad tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:32.337113 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-bef92d19-8432-4089-9329-6f032c472bad tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 14 microversion: 2.1 time: 0.087603 Aug 24 19:35:32.340259 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 468/925] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:32 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 19:35:32.389922 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a04bd5a9-3da2-417a-8aed-9dddbd5a5105 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:32.399203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a04bd5a9-3da2-417a-8aed-9dddbd5a5105 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:32.400829 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a04bd5a9-3da2-417a-8aed-9dddbd5a5105 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:32.402200 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a04bd5a9-3da2-417a-8aed-9dddbd5a5105 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1407 microversion: 2.20 time: 0.176885 Aug 24 19:35:32.402808 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 458/926] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:32 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:35:33.229742 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-473adf48-cfad-46a0-b793-338e4b23f0e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:33.230675 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-473adf48-cfad-46a0-b793-338e4b23f0e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:33.238143 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-473adf48-cfad-46a0-b793-338e4b23f0e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:33.238143 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-473adf48-cfad-46a0-b793-338e4b23f0e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:33.238696 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-473adf48-cfad-46a0-b793-338e4b23f0e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:33.239124 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-473adf48-cfad-46a0-b793-338e4b23f0e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:33.298748 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-473adf48-cfad-46a0-b793-338e4b23f0e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:33.306278 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-473adf48-cfad-46a0-b793-338e4b23f0e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1219 microversion: 2.1 time: 0.080518 Aug 24 19:35:33.306850 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 469/927] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:33 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:33.347374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-de0ec887-53d9-4c1c-870f-e18602092854 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:33.360736 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-de0ec887-53d9-4c1c-870f-e18602092854 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:33.360736 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-de0ec887-53d9-4c1c-870f-e18602092854 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:33.360736 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-de0ec887-53d9-4c1c-870f-e18602092854 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:33.360736 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-de0ec887-53d9-4c1c-870f-e18602092854 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:33.361115 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-de0ec887-53d9-4c1c-870f-e18602092854 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:33.418395 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-de0ec887-53d9-4c1c-870f-e18602092854 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 14 microversion: 2.1 time: 0.074523 Aug 24 19:35:33.421579 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 459/928] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:33 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:35:33.421736 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0b93503c-741a-4269-9895-75d5af14d5fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:33.421736 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0b93503c-741a-4269-9895-75d5af14d5fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:33.426900 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b93503c-741a-4269-9895-75d5af14d5fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:33.427336 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b93503c-741a-4269-9895-75d5af14d5fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:33.428095 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b93503c-741a-4269-9895-75d5af14d5fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:33.428540 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0b93503c-741a-4269-9895-75d5af14d5fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:33.546994 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0b93503c-741a-4269-9895-75d5af14d5fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:33.556569 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0b93503c-741a-4269-9895-75d5af14d5fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:33.558147 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0b93503c-741a-4269-9895-75d5af14d5fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:33.559316 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0b93503c-741a-4269-9895-75d5af14d5fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1407 microversion: 2.20 time: 0.143468 Aug 24 19:35:33.559960 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 470/929] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:33 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1407 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:35:34.323346 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5e3363a3-a188-4c78-ace6-17a7564fa750 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:34.324040 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5e3363a3-a188-4c78-ace6-17a7564fa750 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:34.330639 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5e3363a3-a188-4c78-ace6-17a7564fa750 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:34.331091 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5e3363a3-a188-4c78-ace6-17a7564fa750 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:34.331932 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5e3363a3-a188-4c78-ace6-17a7564fa750 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:34.332690 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5e3363a3-a188-4c78-ace6-17a7564fa750 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:34.396736 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-5e3363a3-a188-4c78-ace6-17a7564fa750 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:34.404307 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5e3363a3-a188-4c78-ace6-17a7564fa750 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1267 microversion: 2.1 time: 0.085093 Aug 24 19:35:34.405075 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 460/930] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:34 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:34.430406 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-77e14bc2-ad6b-44e3-9265-a0d4d5b1ee64 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:34.431339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-77e14bc2-ad6b-44e3-9265-a0d4d5b1ee64 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:34.437983 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-77e14bc2-ad6b-44e3-9265-a0d4d5b1ee64 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:34.438425 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-77e14bc2-ad6b-44e3-9265-a0d4d5b1ee64 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:34.439194 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-77e14bc2-ad6b-44e3-9265-a0d4d5b1ee64 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:34.439623 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-77e14bc2-ad6b-44e3-9265-a0d4d5b1ee64 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:34.499439 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-77e14bc2-ad6b-44e3-9265-a0d4d5b1ee64 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 14 microversion: 2.1 time: 0.074352 Aug 24 19:35:34.502122 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 471/931] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:34 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:35:34.577876 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8204eba9-9bf7-4a19-b161-720dd1927cb8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:34.578406 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8204eba9-9bf7-4a19-b161-720dd1927cb8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:34.584388 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8204eba9-9bf7-4a19-b161-720dd1927cb8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:34.586808 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8204eba9-9bf7-4a19-b161-720dd1927cb8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:34.586808 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8204eba9-9bf7-4a19-b161-720dd1927cb8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:34.586808 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8204eba9-9bf7-4a19-b161-720dd1927cb8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:34.709656 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8204eba9-9bf7-4a19-b161-720dd1927cb8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:34.717409 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8204eba9-9bf7-4a19-b161-720dd1927cb8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:34.718977 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8204eba9-9bf7-4a19-b161-720dd1927cb8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:34.720127 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8204eba9-9bf7-4a19-b161-720dd1927cb8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1407 microversion: 2.20 time: 0.145954 Aug 24 19:35:34.721120 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 461/932] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:34 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:35:35.422291 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-843f51ff-92a9-4aee-be5a-64243da714b6 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:35.422957 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-843f51ff-92a9-4aee-be5a-64243da714b6 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:35.430346 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-843f51ff-92a9-4aee-be5a-64243da714b6 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:35.431039 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-843f51ff-92a9-4aee-be5a-64243da714b6 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:35.431871 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-843f51ff-92a9-4aee-be5a-64243da714b6 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:35.432314 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-843f51ff-92a9-4aee-be5a-64243da714b6 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:35.493998 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-843f51ff-92a9-4aee-be5a-64243da714b6 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:35.501712 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-843f51ff-92a9-4aee-be5a-64243da714b6 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1273 microversion: 2.1 time: 0.083381 Aug 24 19:35:35.502600 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 472/933] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:35 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:35.517222 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5b3d263b-e8ab-4447-943a-b270e665d44a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:35.519757 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5b3d263b-e8ab-4447-943a-b270e665d44a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:35.529654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5b3d263b-e8ab-4447-943a-b270e665d44a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:35.530634 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5b3d263b-e8ab-4447-943a-b270e665d44a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:35.531602 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5b3d263b-e8ab-4447-943a-b270e665d44a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:35.532198 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5b3d263b-e8ab-4447-943a-b270e665d44a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:35.619519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5b3d263b-e8ab-4447-943a-b270e665d44a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 14 microversion: 2.1 time: 0.105618 Aug 24 19:35:35.622688 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 462/934] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:35 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:35:35.738636 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fa42ce57-12b6-4193-8fd0-8a30239714ca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:35.739797 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fa42ce57-12b6-4193-8fd0-8a30239714ca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:35.745489 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fa42ce57-12b6-4193-8fd0-8a30239714ca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:35.745925 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fa42ce57-12b6-4193-8fd0-8a30239714ca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:35.746680 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fa42ce57-12b6-4193-8fd0-8a30239714ca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:35.747101 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fa42ce57-12b6-4193-8fd0-8a30239714ca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:35.879143 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fa42ce57-12b6-4193-8fd0-8a30239714ca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:35.883906 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fa42ce57-12b6-4193-8fd0-8a30239714ca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:35.885509 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fa42ce57-12b6-4193-8fd0-8a30239714ca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:35.886673 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-fa42ce57-12b6-4193-8fd0-8a30239714ca tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1407 microversion: 2.20 time: 0.151847 Aug 24 19:35:35.887309 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 473/935] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:35 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:35:36.522867 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-162c6a66-ae60-4a0e-bad3-7c31205e762e tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:36.523724 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-162c6a66-ae60-4a0e-bad3-7c31205e762e tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:36.530695 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-162c6a66-ae60-4a0e-bad3-7c31205e762e tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:36.531171 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-162c6a66-ae60-4a0e-bad3-7c31205e762e tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:36.531911 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-162c6a66-ae60-4a0e-bad3-7c31205e762e tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:36.532363 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-162c6a66-ae60-4a0e-bad3-7c31205e762e tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:36.630843 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9736be78-d4d9-455b-92e7-1ed9cbdd3715 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:36.631728 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9736be78-d4d9-455b-92e7-1ed9cbdd3715 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:36.638390 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9736be78-d4d9-455b-92e7-1ed9cbdd3715 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:36.638842 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9736be78-d4d9-455b-92e7-1ed9cbdd3715 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:36.639634 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9736be78-d4d9-455b-92e7-1ed9cbdd3715 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:36.640454 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9736be78-d4d9-455b-92e7-1ed9cbdd3715 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:36.666721 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-162c6a66-ae60-4a0e-bad3-7c31205e762e tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:36.679957 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-162c6a66-ae60-4a0e-bad3-7c31205e762e tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1315 microversion: 2.1 time: 0.162545 Aug 24 19:35:36.680826 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 463/936] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:36 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:36.716889 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9736be78-d4d9-455b-92e7-1ed9cbdd3715 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 14 microversion: 2.1 time: 0.089910 Aug 24 19:35:36.717694 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 474/937] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:36 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 19:35:36.904803 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3eddd0ec-1e61-4755-bcca-a7380bbf30bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:36.905371 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3eddd0ec-1e61-4755-bcca-a7380bbf30bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:36.911337 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3eddd0ec-1e61-4755-bcca-a7380bbf30bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:36.912131 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3eddd0ec-1e61-4755-bcca-a7380bbf30bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:36.912566 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3eddd0ec-1e61-4755-bcca-a7380bbf30bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:36.918083 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3eddd0ec-1e61-4755-bcca-a7380bbf30bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:37.080711 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3eddd0ec-1e61-4755-bcca-a7380bbf30bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:37.092463 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3eddd0ec-1e61-4755-bcca-a7380bbf30bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:37.094741 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3eddd0ec-1e61-4755-bcca-a7380bbf30bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:37.096318 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3eddd0ec-1e61-4755-bcca-a7380bbf30bb tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1407 microversion: 2.20 time: 0.195671 Aug 24 19:35:37.097447 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 464/938] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:36 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:35:37.102370 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-8b9e39d6-be47-47e8-a62d-987337e84365 req-80bf23dc-c4d2-4b1c-bbeb-c6971972c30b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7c8a14-baa7-4787-b6dd-21860c419bda", "name": "network-vif-plugged", "status": "completed", "tag": "bdbbbe75-74f7-4905-ad5d-1fc34d1d189b"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:37.104783 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:35:37.104783 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:35:37.116840 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-8b9e39d6-be47-47e8-a62d-987337e84365 req-80bf23dc-c4d2-4b1c-bbeb-c6971972c30b service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:37.117581 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-8b9e39d6-be47-47e8-a62d-987337e84365 req-80bf23dc-c4d2-4b1c-bbeb-c6971972c30b service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:37.133578 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-8b9e39d6-be47-47e8-a62d-987337e84365 req-80bf23dc-c4d2-4b1c-bbeb-c6971972c30b service nova] Creating event network-vif-plugged:bdbbbe75-74f7-4905-ad5d-1fc34d1d189b for instance df7c8a14-baa7-4787-b6dd-21860c419bda on hv-cinder-79819 Aug 24 19:35:37.139614 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-8b9e39d6-be47-47e8-a62d-987337e84365 req-80bf23dc-c4d2-4b1c-bbeb-c6971972c30b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040687 Aug 24 19:35:37.141050 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 465/939] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:35:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:35:37.167880 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-e44c353d-9de7-4f02-9cc3-7b5666cc01d7 req-e7ff59ac-d0d7-429b-990b-d30dbe9bc631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b138b497-914f-471d-8275-c2f8a1026ff7", "tag": "1d452efa-3731-4e49-a7f3-927c85194eb9"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:37.169803 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:35:37.169803 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:35:37.178270 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-e44c353d-9de7-4f02-9cc3-7b5666cc01d7 req-e7ff59ac-d0d7-429b-990b-d30dbe9bc631 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:37.184495 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-e44c353d-9de7-4f02-9cc3-7b5666cc01d7 req-e7ff59ac-d0d7-429b-990b-d30dbe9bc631 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:37.191385 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-e44c353d-9de7-4f02-9cc3-7b5666cc01d7 req-e7ff59ac-d0d7-429b-990b-d30dbe9bc631 service nova] Creating event network-changed:1d452efa-3731-4e49-a7f3-927c85194eb9 for instance b138b497-914f-471d-8275-c2f8a1026ff7 on hv-cinder-79819 Aug 24 19:35:37.196245 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-e44c353d-9de7-4f02-9cc3-7b5666cc01d7 req-e7ff59ac-d0d7-429b-990b-d30dbe9bc631 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.235251 Aug 24 19:35:37.196991 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 475/940] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:35:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:35:37.701915 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8a24b0b3-f819-4d6e-8933-99e2dbdf54e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:37.702603 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8a24b0b3-f819-4d6e-8933-99e2dbdf54e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:37.709625 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8a24b0b3-f819-4d6e-8933-99e2dbdf54e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:37.710110 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8a24b0b3-f819-4d6e-8933-99e2dbdf54e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:37.710872 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8a24b0b3-f819-4d6e-8933-99e2dbdf54e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:37.711462 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8a24b0b3-f819-4d6e-8933-99e2dbdf54e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:37.728245 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1109f7e7-6021-4208-b69b-58c27ffe7695 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:37.729337 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1109f7e7-6021-4208-b69b-58c27ffe7695 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:37.735343 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1109f7e7-6021-4208-b69b-58c27ffe7695 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:37.752823 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1109f7e7-6021-4208-b69b-58c27ffe7695 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:37.752823 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1109f7e7-6021-4208-b69b-58c27ffe7695 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:37.752823 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1109f7e7-6021-4208-b69b-58c27ffe7695 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:37.814088 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1109f7e7-6021-4208-b69b-58c27ffe7695 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 14 microversion: 2.1 time: 0.089614 Aug 24 19:35:37.817331 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 476/941] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:37 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 19:35:37.835519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8a24b0b3-f819-4d6e-8933-99e2dbdf54e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:37.842663 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8a24b0b3-f819-4d6e-8933-99e2dbdf54e0 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1315 microversion: 2.1 time: 0.144667 Aug 24 19:35:37.843223 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 466/942] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:37 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:38.115370 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0768824f-9d9c-4492-8e57-692eac4ae40c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:38.116205 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0768824f-9d9c-4492-8e57-692eac4ae40c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:38.122912 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0768824f-9d9c-4492-8e57-692eac4ae40c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:38.123352 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0768824f-9d9c-4492-8e57-692eac4ae40c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:38.124105 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0768824f-9d9c-4492-8e57-692eac4ae40c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:38.124564 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0768824f-9d9c-4492-8e57-692eac4ae40c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:38.249815 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0768824f-9d9c-4492-8e57-692eac4ae40c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:38.258636 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0768824f-9d9c-4492-8e57-692eac4ae40c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:38.260130 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0768824f-9d9c-4492-8e57-692eac4ae40c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:38.261247 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0768824f-9d9c-4492-8e57-692eac4ae40c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1407 microversion: 2.20 time: 0.149981 Aug 24 19:35:38.261800 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 477/943] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:38 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:35:38.734148 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b94a0cc5-af47-44c6-9173-613e587e03bd tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8fae7c0-9bd8-40d9-b162-acc062705eb2", "device": "/dev/sdb"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:38.735762 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b94a0cc5-af47-44c6-9173-613e587e03bd tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:38.742192 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b94a0cc5-af47-44c6-9173-613e587e03bd tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:38.742701 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b94a0cc5-af47-44c6-9173-613e587e03bd tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:38.743466 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b94a0cc5-af47-44c6-9173-613e587e03bd tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:38.743960 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b94a0cc5-af47-44c6-9173-613e587e03bd tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:38.825076 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-49cd902c-50f5-4cd0-a5f2-43acdb208418 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:38.833485 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-49cd902c-50f5-4cd0-a5f2-43acdb208418 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:38.833485 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-49cd902c-50f5-4cd0-a5f2-43acdb208418 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:38.833485 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-49cd902c-50f5-4cd0-a5f2-43acdb208418 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:38.833485 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-49cd902c-50f5-4cd0-a5f2-43acdb208418 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:38.833869 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-49cd902c-50f5-4cd0-a5f2-43acdb208418 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:38.925361 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-49cd902c-50f5-4cd0-a5f2-43acdb208418 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 14 microversion: 2.1 time: 0.103694 Aug 24 19:35:38.926646 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 478/944] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:38 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 19:35:38.931539 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fd2fd005-b5b7-439f-8762-67e6ae3ebe0a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:38.932293 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fd2fd005-b5b7-439f-8762-67e6ae3ebe0a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:38.938668 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fd2fd005-b5b7-439f-8762-67e6ae3ebe0a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:38.939108 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fd2fd005-b5b7-439f-8762-67e6ae3ebe0a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:38.939861 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fd2fd005-b5b7-439f-8762-67e6ae3ebe0a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:38.940305 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fd2fd005-b5b7-439f-8762-67e6ae3ebe0a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:39.062326 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fd2fd005-b5b7-439f-8762-67e6ae3ebe0a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:39.069814 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-fd2fd005-b5b7-439f-8762-67e6ae3ebe0a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1315 microversion: 2.1 time: 0.141858 Aug 24 19:35:39.070375 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 479/945] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:38 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1315 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:39.279432 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-eabb53a3-28a0-4815-8ce8-bf1ee99cf450 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:39.280033 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-eabb53a3-28a0-4815-8ce8-bf1ee99cf450 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:39.286704 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eabb53a3-28a0-4815-8ce8-bf1ee99cf450 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:39.287150 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eabb53a3-28a0-4815-8ce8-bf1ee99cf450 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:39.287913 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eabb53a3-28a0-4815-8ce8-bf1ee99cf450 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:39.288387 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-eabb53a3-28a0-4815-8ce8-bf1ee99cf450 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:39.408490 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-eabb53a3-28a0-4815-8ce8-bf1ee99cf450 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:39.416724 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-eabb53a3-28a0-4815-8ce8-bf1ee99cf450 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:39.418206 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-eabb53a3-28a0-4815-8ce8-bf1ee99cf450 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:39.419318 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-eabb53a3-28a0-4815-8ce8-bf1ee99cf450 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1599 microversion: 2.20 time: 0.143871 Aug 24 19:35:39.419864 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 480/946] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:35:39 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1599 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:35:39.435779 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-33f9b0f6-dd23-4532-9f36-6084d868cf5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:39.436010 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-33f9b0f6-dd23-4532-9f36-6084d868cf5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:39.441986 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-33f9b0f6-dd23-4532-9f36-6084d868cf5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:39.442431 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-33f9b0f6-dd23-4532-9f36-6084d868cf5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:39.443186 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-33f9b0f6-dd23-4532-9f36-6084d868cf5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:39.443611 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-33f9b0f6-dd23-4532-9f36-6084d868cf5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:39.520676 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-33f9b0f6-dd23-4532-9f36-6084d868cf5a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087772 Aug 24 19:35:39.521269 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 481/947] 10.222.0.59 () {60 vars in 1316 bytes} [Tue Aug 24 19:35:39 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:35:39.648596 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b94a0cc5-af47-44c6-9173-613e587e03bd tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "POST /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.917978 Aug 24 19:35:39.649217 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 467/948] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 24 19:35:38 2021] POST /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269/os-volume_attachments => generated 194 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:35:39.936236 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ebe039dc-4453-4aff-8d6a-034607a71fea tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:39.937235 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ebe039dc-4453-4aff-8d6a-034607a71fea tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:39.944313 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ebe039dc-4453-4aff-8d6a-034607a71fea tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:39.944753 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ebe039dc-4453-4aff-8d6a-034607a71fea tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:39.945516 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ebe039dc-4453-4aff-8d6a-034607a71fea tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:39.945977 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ebe039dc-4453-4aff-8d6a-034607a71fea tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:40.007209 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ebe039dc-4453-4aff-8d6a-034607a71fea tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 14 microversion: 2.1 time: 0.074584 Aug 24 19:35:40.007835 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 482/949] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:39 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:35:40.087288 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6d99407f-00cf-437e-bf7b-c7414167cfec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:40.087970 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6d99407f-00cf-437e-bf7b-c7414167cfec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:40.094716 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6d99407f-00cf-437e-bf7b-c7414167cfec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:40.095163 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6d99407f-00cf-437e-bf7b-c7414167cfec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:40.095927 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6d99407f-00cf-437e-bf7b-c7414167cfec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:40.096385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6d99407f-00cf-437e-bf7b-c7414167cfec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:40.217077 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6d99407f-00cf-437e-bf7b-c7414167cfec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:40.226122 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6d99407f-00cf-437e-bf7b-c7414167cfec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1315 microversion: 2.1 time: 0.143224 Aug 24 19:35:40.226739 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 468/950] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:40 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:40.503058 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-bd7c0d8f-5ef9-40aa-a4e7-0455dde65645 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:40.504048 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-bd7c0d8f-5ef9-40aa-a4e7-0455dde65645 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:40.511014 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bd7c0d8f-5ef9-40aa-a4e7-0455dde65645 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:40.511457 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bd7c0d8f-5ef9-40aa-a4e7-0455dde65645 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:40.511803 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-01c07691-ecb5-4462-9664-04b5a5640c2a req-66f0cb5c-758e-4c66-8652-27c0a09075da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df7c8a14-baa7-4787-b6dd-21860c419bda", "tag": "bdbbbe75-74f7-4905-ad5d-1fc34d1d189b"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:40.512400 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bd7c0d8f-5ef9-40aa-a4e7-0455dde65645 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:40.512827 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bd7c0d8f-5ef9-40aa-a4e7-0455dde65645 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:40.513358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:35:40.513358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:35:40.520205 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-01c07691-ecb5-4462-9664-04b5a5640c2a req-66f0cb5c-758e-4c66-8652-27c0a09075da service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:40.526807 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-01c07691-ecb5-4462-9664-04b5a5640c2a req-66f0cb5c-758e-4c66-8652-27c0a09075da service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:40.533759 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-01c07691-ecb5-4462-9664-04b5a5640c2a req-66f0cb5c-758e-4c66-8652-27c0a09075da service nova] Creating event network-changed:bdbbbe75-74f7-4905-ad5d-1fc34d1d189b for instance df7c8a14-baa7-4787-b6dd-21860c419bda on hv-cinder-79819 Aug 24 19:35:40.539268 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-01c07691-ecb5-4462-9664-04b5a5640c2a req-66f0cb5c-758e-4c66-8652-27c0a09075da service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030981 Aug 24 19:35:40.539964 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 469/951] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:35:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:35:40.582976 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-bd7c0d8f-5ef9-40aa-a4e7-0455dde65645 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 14 microversion: 2.20 time: 0.083965 Aug 24 19:35:40.583808 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 483/952] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:35:40 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:41.018939 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ade4497c-c027-432f-8935-a808e4a021d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:41.020780 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ade4497c-c027-432f-8935-a808e4a021d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:41.027543 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ade4497c-c027-432f-8935-a808e4a021d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:41.027996 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ade4497c-c027-432f-8935-a808e4a021d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:41.028827 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ade4497c-c027-432f-8935-a808e4a021d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:41.029263 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ade4497c-c027-432f-8935-a808e4a021d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:41.102178 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ade4497c-c027-432f-8935-a808e4a021d5 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 14 microversion: 2.1 time: 0.087502 Aug 24 19:35:41.109742 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 470/953] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:41 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:35:41.243777 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9044444b-ef6b-4be3-8b7b-3df9f2a5dd2a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:41.244582 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9044444b-ef6b-4be3-8b7b-3df9f2a5dd2a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:41.251109 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9044444b-ef6b-4be3-8b7b-3df9f2a5dd2a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:41.251539 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9044444b-ef6b-4be3-8b7b-3df9f2a5dd2a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:41.252332 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9044444b-ef6b-4be3-8b7b-3df9f2a5dd2a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:41.252765 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9044444b-ef6b-4be3-8b7b-3df9f2a5dd2a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:41.380257 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9044444b-ef6b-4be3-8b7b-3df9f2a5dd2a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:41.387812 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9044444b-ef6b-4be3-8b7b-3df9f2a5dd2a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1315 microversion: 2.1 time: 0.148190 Aug 24 19:35:41.388386 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 484/954] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:41 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:41.594724 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1a0ea92c-d36f-463a-86f2-efd99e6ca069 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:41.595688 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1a0ea92c-d36f-463a-86f2-efd99e6ca069 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:41.602181 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1a0ea92c-d36f-463a-86f2-efd99e6ca069 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:41.602621 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1a0ea92c-d36f-463a-86f2-efd99e6ca069 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:41.603373 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1a0ea92c-d36f-463a-86f2-efd99e6ca069 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:41.603823 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1a0ea92c-d36f-463a-86f2-efd99e6ca069 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:41.664066 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1a0ea92c-d36f-463a-86f2-efd99e6ca069 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 14 microversion: 2.20 time: 0.073092 Aug 24 19:35:41.667400 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 471/955] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:35:41 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:42.113605 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-98d78109-b4de-4f6b-bd95-afc01d46d27a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:42.114430 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-98d78109-b4de-4f6b-bd95-afc01d46d27a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:42.120200 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-98d78109-b4de-4f6b-bd95-afc01d46d27a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:42.120684 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-98d78109-b4de-4f6b-bd95-afc01d46d27a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:42.121431 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-98d78109-b4de-4f6b-bd95-afc01d46d27a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:42.121853 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-98d78109-b4de-4f6b-bd95-afc01d46d27a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:42.217700 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-98d78109-b4de-4f6b-bd95-afc01d46d27a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 11454 microversion: 2.1 time: 0.108066 Aug 24 19:35:42.218336 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 485/956] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:42 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 11454 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:35:42.405358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ce22885a-0db8-468a-afb9-dd55b0767d11 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:42.406052 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ce22885a-0db8-468a-afb9-dd55b0767d11 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:42.412589 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ce22885a-0db8-468a-afb9-dd55b0767d11 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:42.413027 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ce22885a-0db8-468a-afb9-dd55b0767d11 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:42.413785 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ce22885a-0db8-468a-afb9-dd55b0767d11 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:42.414210 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ce22885a-0db8-468a-afb9-dd55b0767d11 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:42.532986 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ce22885a-0db8-468a-afb9-dd55b0767d11 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:42.540818 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ce22885a-0db8-468a-afb9-dd55b0767d11 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1315 microversion: 2.1 time: 0.139790 Aug 24 19:35:42.541396 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 472/957] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:42 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:42.676288 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c505849b-46a0-46ee-bb14-70d3db771a9b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:42.677208 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c505849b-46a0-46ee-bb14-70d3db771a9b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:42.684054 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c505849b-46a0-46ee-bb14-70d3db771a9b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:42.686771 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c505849b-46a0-46ee-bb14-70d3db771a9b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:42.686771 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c505849b-46a0-46ee-bb14-70d3db771a9b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:42.686771 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c505849b-46a0-46ee-bb14-70d3db771a9b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:42.742949 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c505849b-46a0-46ee-bb14-70d3db771a9b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 14 microversion: 2.20 time: 0.071372 Aug 24 19:35:42.743741 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 486/958] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:35:42 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:43.072495 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-540acfb5-7606-4991-ba03-c086adce1406 req-f7ee1739-417d-41ca-9636-fecf46f2b6ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b138b497-914f-471d-8275-c2f8a1026ff7", "name": "network-vif-plugged", "status": "completed", "tag": "1d452efa-3731-4e49-a7f3-927c85194eb9"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:43.074200 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:35:43.074200 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:35:43.080937 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-540acfb5-7606-4991-ba03-c086adce1406 req-f7ee1739-417d-41ca-9636-fecf46f2b6ea service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:43.082307 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-540acfb5-7606-4991-ba03-c086adce1406 req-f7ee1739-417d-41ca-9636-fecf46f2b6ea service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:43.092243 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-540acfb5-7606-4991-ba03-c086adce1406 req-f7ee1739-417d-41ca-9636-fecf46f2b6ea service nova] Creating event network-vif-plugged:1d452efa-3731-4e49-a7f3-927c85194eb9 for instance b138b497-914f-471d-8275-c2f8a1026ff7 on hv-cinder-79819 Aug 24 19:35:43.097018 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-540acfb5-7606-4991-ba03-c086adce1406 req-f7ee1739-417d-41ca-9636-fecf46f2b6ea service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028244 Aug 24 19:35:43.098224 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 473/959] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:35:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:35:43.230678 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-377a58aa-17c2-45ea-ac95-9a5bf9152355 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:43.231651 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-377a58aa-17c2-45ea-ac95-9a5bf9152355 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:43.239983 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-377a58aa-17c2-45ea-ac95-9a5bf9152355 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:43.240468 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-377a58aa-17c2-45ea-ac95-9a5bf9152355 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:43.241431 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-377a58aa-17c2-45ea-ac95-9a5bf9152355 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:43.241710 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-377a58aa-17c2-45ea-ac95-9a5bf9152355 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:43.323895 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-377a58aa-17c2-45ea-ac95-9a5bf9152355 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 18356 microversion: 2.1 time: 0.097814 Aug 24 19:35:43.324769 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 487/960] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:43 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 18356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:35:43.557895 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-05535eab-f060-4a1b-ba75-53eb52436962 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:43.558619 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-05535eab-f060-4a1b-ba75-53eb52436962 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:43.564707 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05535eab-f060-4a1b-ba75-53eb52436962 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:43.565158 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05535eab-f060-4a1b-ba75-53eb52436962 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:43.565919 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05535eab-f060-4a1b-ba75-53eb52436962 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:43.566351 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05535eab-f060-4a1b-ba75-53eb52436962 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:43.684847 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-05535eab-f060-4a1b-ba75-53eb52436962 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:43.692012 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-05535eab-f060-4a1b-ba75-53eb52436962 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1315 microversion: 2.1 time: 0.138481 Aug 24 19:35:43.692597 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 474/961] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:43 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:43.754818 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f39f5c8e-92e2-4ce6-a103-ebc4d1748259 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:43.755723 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f39f5c8e-92e2-4ce6-a103-ebc4d1748259 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:43.762294 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f39f5c8e-92e2-4ce6-a103-ebc4d1748259 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:43.762749 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f39f5c8e-92e2-4ce6-a103-ebc4d1748259 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:43.763653 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f39f5c8e-92e2-4ce6-a103-ebc4d1748259 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:43.764088 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f39f5c8e-92e2-4ce6-a103-ebc4d1748259 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:43.842727 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f39f5c8e-92e2-4ce6-a103-ebc4d1748259 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 14 microversion: 2.20 time: 0.092149 Aug 24 19:35:43.843330 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 488/962] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:35:43 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:44.335874 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3bc6d7e1-2bf5-4fda-baa1-30990125161c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:44.336823 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3bc6d7e1-2bf5-4fda-baa1-30990125161c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:44.342592 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3bc6d7e1-2bf5-4fda-baa1-30990125161c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:44.343036 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3bc6d7e1-2bf5-4fda-baa1-30990125161c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:44.343799 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3bc6d7e1-2bf5-4fda-baa1-30990125161c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:44.344221 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3bc6d7e1-2bf5-4fda-baa1-30990125161c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:44.428833 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3bc6d7e1-2bf5-4fda-baa1-30990125161c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 18703 microversion: 2.1 time: 0.097051 Aug 24 19:35:44.429506 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 475/963] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:44 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 18703 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:35:44.709302 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4b9b0230-82a7-4c6c-960d-0dafafe6b9c7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:44.710006 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4b9b0230-82a7-4c6c-960d-0dafafe6b9c7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:44.716484 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b9b0230-82a7-4c6c-960d-0dafafe6b9c7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:44.716940 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b9b0230-82a7-4c6c-960d-0dafafe6b9c7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:44.717702 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b9b0230-82a7-4c6c-960d-0dafafe6b9c7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:44.718129 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4b9b0230-82a7-4c6c-960d-0dafafe6b9c7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:44.846366 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4b9b0230-82a7-4c6c-960d-0dafafe6b9c7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:44.854722 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5c37eced-eed5-487a-be2d-96b27befa231 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:44.855253 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4b9b0230-82a7-4c6c-960d-0dafafe6b9c7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1315 microversion: 2.1 time: 0.149616 Aug 24 19:35:44.855381 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 489/964] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:44 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:44.856661 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5c37eced-eed5-487a-be2d-96b27befa231 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:44.864104 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5c37eced-eed5-487a-be2d-96b27befa231 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:44.864565 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5c37eced-eed5-487a-be2d-96b27befa231 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:44.865338 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5c37eced-eed5-487a-be2d-96b27befa231 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:44.865761 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5c37eced-eed5-487a-be2d-96b27befa231 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:44.930694 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5c37eced-eed5-487a-be2d-96b27befa231 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 14 microversion: 2.20 time: 0.080013 Aug 24 19:35:44.931374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 476/965] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:35:44 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:35:45.440173 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b4ed40fc-bfd4-4940-bd7e-589e1e298a56 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:45.441054 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b4ed40fc-bfd4-4940-bd7e-589e1e298a56 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:45.446949 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b4ed40fc-bfd4-4940-bd7e-589e1e298a56 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:45.447422 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b4ed40fc-bfd4-4940-bd7e-589e1e298a56 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:45.448181 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b4ed40fc-bfd4-4940-bd7e-589e1e298a56 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:45.448640 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b4ed40fc-bfd4-4940-bd7e-589e1e298a56 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:45.519627 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b4ed40fc-bfd4-4940-bd7e-589e1e298a56 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 20997 microversion: 2.1 time: 0.082420 Aug 24 19:35:45.520299 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 490/966] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:45 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 20997 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:35:45.876413 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3dedfef3-8949-4d47-986a-a60e29cf2dec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:45.877115 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3dedfef3-8949-4d47-986a-a60e29cf2dec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:45.884490 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3dedfef3-8949-4d47-986a-a60e29cf2dec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:45.884946 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3dedfef3-8949-4d47-986a-a60e29cf2dec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:45.885731 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3dedfef3-8949-4d47-986a-a60e29cf2dec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:45.886167 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3dedfef3-8949-4d47-986a-a60e29cf2dec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:45.943543 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4414bdde-a894-4857-a1a0-1571d119c124 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:45.944665 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4414bdde-a894-4857-a1a0-1571d119c124 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:45.951225 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4414bdde-a894-4857-a1a0-1571d119c124 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:45.951670 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4414bdde-a894-4857-a1a0-1571d119c124 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:45.952470 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4414bdde-a894-4857-a1a0-1571d119c124 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:45.952898 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4414bdde-a894-4857-a1a0-1571d119c124 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:46.007610 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3dedfef3-8949-4d47-986a-a60e29cf2dec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:46.015189 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3dedfef3-8949-4d47-986a-a60e29cf2dec tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1464 microversion: 2.1 time: 0.142871 Aug 24 19:35:46.015738 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 477/967] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:45 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1464 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:46.020770 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4414bdde-a894-4857-a1a0-1571d119c124 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 14 microversion: 2.20 time: 0.081679 Aug 24 19:35:46.021577 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 491/968] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:35:45 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:46.062134 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-621b80b5-1568-4777-b4a6-d34784449c15 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:46.062631 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-621b80b5-1568-4777-b4a6-d34784449c15 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:46.069317 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-621b80b5-1568-4777-b4a6-d34784449c15 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:46.069764 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-621b80b5-1568-4777-b4a6-d34784449c15 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:46.070523 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-621b80b5-1568-4777-b4a6-d34784449c15 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:46.070952 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-621b80b5-1568-4777-b4a6-d34784449c15 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:46.095182 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-621b80b5-1568-4777-b4a6-d34784449c15 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Going to try to terminate instance {{(pid=108908) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:35:46.471046 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-621b80b5-1568-4777-b4a6-d34784449c15 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "DELETE /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 204 len: 0 microversion: 2.1 time: 0.412293 Aug 24 19:35:46.471629 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 478/969] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:35:46 2021] DELETE /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:35:46.480649 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0945e867-a4c8-46ea-8676-a9f48b4c7c67 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:46.481368 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0945e867-a4c8-46ea-8676-a9f48b4c7c67 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:46.488479 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0945e867-a4c8-46ea-8676-a9f48b4c7c67 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:46.490804 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0945e867-a4c8-46ea-8676-a9f48b4c7c67 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:46.490804 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0945e867-a4c8-46ea-8676-a9f48b4c7c67 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:46.490804 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0945e867-a4c8-46ea-8676-a9f48b4c7c67 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:46.531878 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6e259a58-1541-48fe-a812-589633e3efbc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:46.532961 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6e259a58-1541-48fe-a812-589633e3efbc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:46.539509 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6e259a58-1541-48fe-a812-589633e3efbc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:46.539960 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6e259a58-1541-48fe-a812-589633e3efbc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:46.540878 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6e259a58-1541-48fe-a812-589633e3efbc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:46.541320 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6e259a58-1541-48fe-a812-589633e3efbc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:46.609955 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0945e867-a4c8-46ea-8676-a9f48b4c7c67 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:46.617875 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0945e867-a4c8-46ea-8676-a9f48b4c7c67 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1470 microversion: 2.1 time: 0.141354 Aug 24 19:35:46.618434 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 492/970] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:46 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1470 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:46.631877 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6e259a58-1541-48fe-a812-589633e3efbc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 22716 microversion: 2.1 time: 0.103786 Aug 24 19:35:46.632555 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 479/971] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:46 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 22716 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:35:47.031693 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0fda6b05-5b1d-472b-a70f-4f9d59ed769f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:47.032620 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0fda6b05-5b1d-472b-a70f-4f9d59ed769f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:47.038596 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0fda6b05-5b1d-472b-a70f-4f9d59ed769f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:47.039032 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0fda6b05-5b1d-472b-a70f-4f9d59ed769f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:47.039777 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0fda6b05-5b1d-472b-a70f-4f9d59ed769f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:47.040299 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0fda6b05-5b1d-472b-a70f-4f9d59ed769f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:47.109468 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0fda6b05-5b1d-472b-a70f-4f9d59ed769f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 14 microversion: 2.20 time: 0.081197 Aug 24 19:35:47.111872 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 493/972] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:35:47 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:47.635177 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5be70d3a-81bf-4d02-884b-00166be36b42 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:47.635868 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5be70d3a-81bf-4d02-884b-00166be36b42 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:47.642464 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5be70d3a-81bf-4d02-884b-00166be36b42 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:47.642912 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5be70d3a-81bf-4d02-884b-00166be36b42 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:47.643266 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d47d0b62-5237-4447-88db-ae32f6f99c06 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:47.644174 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5be70d3a-81bf-4d02-884b-00166be36b42 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:47.644627 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5be70d3a-81bf-4d02-884b-00166be36b42 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:47.644753 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d47d0b62-5237-4447-88db-ae32f6f99c06 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:47.651793 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d47d0b62-5237-4447-88db-ae32f6f99c06 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:47.652239 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d47d0b62-5237-4447-88db-ae32f6f99c06 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:47.653085 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d47d0b62-5237-4447-88db-ae32f6f99c06 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:47.653542 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d47d0b62-5237-4447-88db-ae32f6f99c06 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:47.730419 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d47d0b62-5237-4447-88db-ae32f6f99c06 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 23803 microversion: 2.1 time: 0.090807 Aug 24 19:35:47.731462 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 494/973] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:47 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 23803 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:35:47.771200 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-5be70d3a-81bf-4d02-884b-00166be36b42 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:47.779073 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5be70d3a-81bf-4d02-884b-00166be36b42 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1470 microversion: 2.1 time: 0.147867 Aug 24 19:35:47.779663 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 480/974] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:47 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:48.121292 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5f5c9159-4391-4ad1-a906-bb807bbabc5e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:48.122269 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5f5c9159-4391-4ad1-a906-bb807bbabc5e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:48.129015 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5f5c9159-4391-4ad1-a906-bb807bbabc5e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:48.130045 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5f5c9159-4391-4ad1-a906-bb807bbabc5e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:48.130818 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5f5c9159-4391-4ad1-a906-bb807bbabc5e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:48.131245 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5f5c9159-4391-4ad1-a906-bb807bbabc5e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:48.200471 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5f5c9159-4391-4ad1-a906-bb807bbabc5e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 14 microversion: 2.20 time: 0.083065 Aug 24 19:35:48.201106 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 495/975] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:35:48 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:48.706800 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-70eca0a3-063f-4405-8896-e981c5613cb8 req-65f5769b-3dd0-4d49-81da-45123ab80d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b138b497-914f-471d-8275-c2f8a1026ff7", "name": "network-vif-deleted", "tag": "1d452efa-3731-4e49-a7f3-927c85194eb9"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:48.708472 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:35:48.708472 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:35:48.716133 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-70eca0a3-063f-4405-8896-e981c5613cb8 req-65f5769b-3dd0-4d49-81da-45123ab80d89 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:48.716580 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-70eca0a3-063f-4405-8896-e981c5613cb8 req-65f5769b-3dd0-4d49-81da-45123ab80d89 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:48.728614 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-70eca0a3-063f-4405-8896-e981c5613cb8 req-65f5769b-3dd0-4d49-81da-45123ab80d89 service nova] Creating event network-vif-deleted:1d452efa-3731-4e49-a7f3-927c85194eb9 for instance b138b497-914f-471d-8275-c2f8a1026ff7 on hv-cinder-79819 Aug 24 19:35:48.733821 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-70eca0a3-063f-4405-8896-e981c5613cb8 req-65f5769b-3dd0-4d49-81da-45123ab80d89 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031220 Aug 24 19:35:48.734487 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 481/976] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:35:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:35:48.745014 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-194ba656-fff0-4cee-9e07-7a758f34be44 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:48.746026 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-194ba656-fff0-4cee-9e07-7a758f34be44 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:48.752820 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-194ba656-fff0-4cee-9e07-7a758f34be44 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:48.753259 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-194ba656-fff0-4cee-9e07-7a758f34be44 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:48.754083 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-194ba656-fff0-4cee-9e07-7a758f34be44 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:48.754514 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-194ba656-fff0-4cee-9e07-7a758f34be44 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:48.796605 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-fec19d27-463a-41ce-b69b-edb4b584533a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:48.797305 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-fec19d27-463a-41ce-b69b-edb4b584533a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:48.804496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fec19d27-463a-41ce-b69b-edb4b584533a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:48.804944 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fec19d27-463a-41ce-b69b-edb4b584533a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:48.809920 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fec19d27-463a-41ce-b69b-edb4b584533a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:48.809920 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fec19d27-463a-41ce-b69b-edb4b584533a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:48.830361 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-194ba656-fff0-4cee-9e07-7a758f34be44 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 25025 microversion: 2.1 time: 0.091491 Aug 24 19:35:48.831548 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 496/977] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:48 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 25025 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:35:48.871217 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-fec19d27-463a-41ce-b69b-edb4b584533a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:48.878377 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-fec19d27-463a-41ce-b69b-edb4b584533a tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1428 microversion: 2.1 time: 0.085987 Aug 24 19:35:48.879673 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 482/978] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:48 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:35:49.212138 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b84de9f2-16f4-47a4-afc3-7f4cbcf787f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:49.213195 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b84de9f2-16f4-47a4-afc3-7f4cbcf787f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:49.219762 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b84de9f2-16f4-47a4-afc3-7f4cbcf787f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:49.220202 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b84de9f2-16f4-47a4-afc3-7f4cbcf787f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:49.220981 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b84de9f2-16f4-47a4-afc3-7f4cbcf787f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:49.221408 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b84de9f2-16f4-47a4-afc3-7f4cbcf787f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:49.842632 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a781c618-6b34-48fd-818c-e5c54f943e27 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:49.844175 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a781c618-6b34-48fd-818c-e5c54f943e27 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:49.850912 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a781c618-6b34-48fd-818c-e5c54f943e27 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:49.851410 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a781c618-6b34-48fd-818c-e5c54f943e27 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:49.852187 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a781c618-6b34-48fd-818c-e5c54f943e27 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:49.852646 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a781c618-6b34-48fd-818c-e5c54f943e27 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:51.974647 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b84de9f2-16f4-47a4-afc3-7f4cbcf787f0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 14 microversion: 2.20 time: 2.765858 Aug 24 19:35:51.975286 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 497/979] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:35:49 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 14 bytes in 2768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:51.980363 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5cb24df5-c983-44e8-9e91-1096d8e2a8e7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:51.981134 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5cb24df5-c983-44e8-9e91-1096d8e2a8e7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:51.987623 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5cb24df5-c983-44e8-9e91-1096d8e2a8e7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:51.988133 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5cb24df5-c983-44e8-9e91-1096d8e2a8e7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:51.988950 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5cb24df5-c983-44e8-9e91-1096d8e2a8e7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:51.989386 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5cb24df5-c983-44e8-9e91-1096d8e2a8e7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:52.019517 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5cb24df5-c983-44e8-9e91-1096d8e2a8e7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:52.019962 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5cb24df5-c983-44e8-9e91-1096d8e2a8e7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:52.020454 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-5cb24df5-c983-44e8-9e91-1096d8e2a8e7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lazy-loading 'fault' on Instance uuid b138b497-914f-471d-8275-c2f8a1026ff7 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:35:52.048305 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a781c618-6b34-48fd-818c-e5c54f943e27 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 27598 microversion: 2.1 time: 2.209072 Aug 24 19:35:52.049267 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 483/980] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:49 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 27598 bytes in 2211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:35:52.060173 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5cb24df5-c983-44e8-9e91-1096d8e2a8e7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bee3377ff65647fb9ec50fbba32d2db4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5078624c8df4bc3a3be81135112b9c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:35:52.067529 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5cb24df5-c983-44e8-9e91-1096d8e2a8e7 tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 200 len: 1305 microversion: 2.1 time: 0.091003 Aug 24 19:35:52.068077 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 498/981] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:51 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 1305 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:52.986297 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4a5ceafb-cefe-41fb-9a6f-c639f17eb6a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:52.987295 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4a5ceafb-cefe-41fb-9a6f-c639f17eb6a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:52.993678 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4a5ceafb-cefe-41fb-9a6f-c639f17eb6a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:52.994127 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4a5ceafb-cefe-41fb-9a6f-c639f17eb6a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:52.994886 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4a5ceafb-cefe-41fb-9a6f-c639f17eb6a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:52.995317 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4a5ceafb-cefe-41fb-9a6f-c639f17eb6a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:53.058835 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f022a70e-9567-424d-b87d-0a112ef537c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:53.060229 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f022a70e-9567-424d-b87d-0a112ef537c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:53.062248 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4a5ceafb-cefe-41fb-9a6f-c639f17eb6a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 14 microversion: 2.20 time: 0.080215 Aug 24 19:35:53.065485 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 484/982] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:35:52 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:35:53.066813 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f022a70e-9567-424d-b87d-0a112ef537c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:53.067261 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f022a70e-9567-424d-b87d-0a112ef537c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:53.068603 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f022a70e-9567-424d-b87d-0a112ef537c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:53.069032 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f022a70e-9567-424d-b87d-0a112ef537c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:53.095198 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-7a72e93a-1d0d-4e48-9844-820280b9a83c tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:35:53.095198 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-7a72e93a-1d0d-4e48-9844-820280b9a83c tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] [instance: b138b497-914f-471d-8275-c2f8a1026ff7] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:53.095198 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7a72e93a-1d0d-4e48-9844-820280b9a83c tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:53.095198 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7a72e93a-1d0d-4e48-9844-820280b9a83c tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:53.095618 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7a72e93a-1d0d-4e48-9844-820280b9a83c tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:53.095618 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7a72e93a-1d0d-4e48-9844-820280b9a83c tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:53.108063 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-7a72e93a-1d0d-4e48-9844-820280b9a83c tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] HTTP exception thrown: Instance b138b497-914f-471d-8275-c2f8a1026ff7 could not be found. Aug 24 19:35:53.108679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-7a72e93a-1d0d-4e48-9844-820280b9a83c tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] Returning 404 to user: Instance b138b497-914f-471d-8275-c2f8a1026ff7 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:35:53.109524 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-7a72e93a-1d0d-4e48-9844-820280b9a83c tempest-VolumesNegativeTest-317978442 tempest-VolumesNegativeTest-317978442-project] 10.222.0.59 "GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7" status: 404 len: 111 microversion: 2.1 time: 0.028657 Aug 24 19:35:53.110062 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 485/983] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:35:53 2021] GET /compute/v2.1/servers/b138b497-914f-471d-8275-c2f8a1026ff7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 19:35:53.159765 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f022a70e-9567-424d-b87d-0a112ef537c9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 27956 microversion: 2.1 time: 0.104394 Aug 24 19:35:53.160407 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 499/984] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:53 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 27956 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:35:54.073139 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3ef2ed2b-4a4e-4f6b-b86b-591852455692 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:54.074044 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3ef2ed2b-4a4e-4f6b-b86b-591852455692 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:54.079650 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3ef2ed2b-4a4e-4f6b-b86b-591852455692 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:54.080081 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3ef2ed2b-4a4e-4f6b-b86b-591852455692 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:54.081021 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3ef2ed2b-4a4e-4f6b-b86b-591852455692 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:54.081444 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3ef2ed2b-4a4e-4f6b-b86b-591852455692 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:54.171822 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a764a924-2d2d-4e82-9f64-ff11abc25d54 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:54.172725 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a764a924-2d2d-4e82-9f64-ff11abc25d54 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:54.179098 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a764a924-2d2d-4e82-9f64-ff11abc25d54 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:54.179536 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a764a924-2d2d-4e82-9f64-ff11abc25d54 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:54.180410 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a764a924-2d2d-4e82-9f64-ff11abc25d54 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:54.180839 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a764a924-2d2d-4e82-9f64-ff11abc25d54 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:56.341862 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3ef2ed2b-4a4e-4f6b-b86b-591852455692 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 18498 microversion: 2.20 time: 2.272422 Aug 24 19:35:56.343038 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 486/985] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:35:54 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 18498 bytes in 2274 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:35:56.359820 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a764a924-2d2d-4e82-9f64-ff11abc25d54 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 28190 microversion: 2.1 time: 2.191941 Aug 24 19:35:56.360749 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 500/986] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:54 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 28190 bytes in 2194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:35:57.365202 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4aa47e1f-dd53-4088-9a1a-5306fd1ffc8e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:57.366089 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4aa47e1f-dd53-4088-9a1a-5306fd1ffc8e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:57.371567 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-576a4c6d-e71a-42e6-a8b0-50c65de49881 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:57.372596 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-576a4c6d-e71a-42e6-a8b0-50c65de49881 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:57.373041 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4aa47e1f-dd53-4088-9a1a-5306fd1ffc8e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:57.373488 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4aa47e1f-dd53-4088-9a1a-5306fd1ffc8e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:57.375340 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4aa47e1f-dd53-4088-9a1a-5306fd1ffc8e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:57.375340 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4aa47e1f-dd53-4088-9a1a-5306fd1ffc8e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:57.379203 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-576a4c6d-e71a-42e6-a8b0-50c65de49881 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:57.379649 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-576a4c6d-e71a-42e6-a8b0-50c65de49881 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:57.380452 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-576a4c6d-e71a-42e6-a8b0-50c65de49881 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:57.380883 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-576a4c6d-e71a-42e6-a8b0-50c65de49881 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:57.455053 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4aa47e1f-dd53-4088-9a1a-5306fd1ffc8e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 19342 microversion: 2.20 time: 0.093799 Aug 24 19:35:57.455677 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 487/987] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:35:57 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 19342 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:35:57.465859 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-576a4c6d-e71a-42e6-a8b0-50c65de49881 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 28190 microversion: 2.1 time: 0.098347 Aug 24 19:35:57.466716 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 501/988] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:57 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 28190 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:35:58.467570 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c33fd4f6-caf0-422c-9d7b-54030201fc6d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:58.468605 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-c33fd4f6-caf0-422c-9d7b-54030201fc6d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:58.475478 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c33fd4f6-caf0-422c-9d7b-54030201fc6d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:58.480003 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c33fd4f6-caf0-422c-9d7b-54030201fc6d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:58.480003 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c33fd4f6-caf0-422c-9d7b-54030201fc6d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:58.480003 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c33fd4f6-caf0-422c-9d7b-54030201fc6d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:58.480352 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a5c6839f-fe6d-4c25-a9b7-59bc83392127 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:35:58.480352 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a5c6839f-fe6d-4c25-a9b7-59bc83392127 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:35:58.484928 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a5c6839f-fe6d-4c25-a9b7-59bc83392127 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:58.485375 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a5c6839f-fe6d-4c25-a9b7-59bc83392127 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:35:58.486146 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a5c6839f-fe6d-4c25-a9b7-59bc83392127 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:35:58.486578 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a5c6839f-fe6d-4c25-a9b7-59bc83392127 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:00.906918 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c33fd4f6-caf0-422c-9d7b-54030201fc6d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 25078 microversion: 2.20 time: 2.442935 Aug 24 19:36:00.907900 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 488/989] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:35:58 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 25078 bytes in 2445 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:00.925337 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a5c6839f-fe6d-4c25-a9b7-59bc83392127 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 28481 microversion: 2.1 time: 2.451677 Aug 24 19:36:00.926521 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 502/990] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:35:58 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 28481 bytes in 2454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:36:01.919316 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0adfb752-026b-4866-b13e-bb5a83be997c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:01.920344 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0adfb752-026b-4866-b13e-bb5a83be997c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:01.926946 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0adfb752-026b-4866-b13e-bb5a83be997c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:01.927393 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0adfb752-026b-4866-b13e-bb5a83be997c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:01.928156 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0adfb752-026b-4866-b13e-bb5a83be997c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:01.928610 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0adfb752-026b-4866-b13e-bb5a83be997c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:01.944108 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f14fe4e4-fd9f-468b-87a6-a16bc8b697d4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:01.944108 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f14fe4e4-fd9f-468b-87a6-a16bc8b697d4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:01.946805 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f14fe4e4-fd9f-468b-87a6-a16bc8b697d4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:01.947285 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f14fe4e4-fd9f-468b-87a6-a16bc8b697d4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:01.948063 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f14fe4e4-fd9f-468b-87a6-a16bc8b697d4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:01.948529 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f14fe4e4-fd9f-468b-87a6-a16bc8b697d4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:02.015000 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0adfb752-026b-4866-b13e-bb5a83be997c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 26336 microversion: 2.20 time: 0.099582 Aug 24 19:36:02.018800 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 489/991] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:01 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 26336 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:02.044667 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f14fe4e4-fd9f-468b-87a6-a16bc8b697d4 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 28645 microversion: 2.1 time: 0.110659 Aug 24 19:36:02.045250 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 503/992] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:01 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 28645 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:36:02.391315 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-14fb0a84-9953-4c0e-9206-208170cc3a13 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1714711462"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:02.391870 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-14fb0a84-9953-4c0e-9206-208170cc3a13 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:02.399757 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-14fb0a84-9953-4c0e-9206-208170cc3a13 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:02.401038 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-14fb0a84-9953-4c0e-9206-208170cc3a13 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:02.401175 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-14fb0a84-9953-4c0e-9206-208170cc3a13 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:02.401573 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-14fb0a84-9953-4c0e-9206-208170cc3a13 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:02.515732 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.network.security_group_api [None req-14fb0a84-9953-4c0e-9206-208170cc3a13 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Removing security group 25a9a168-302d-46d0-bfdb-fb3adc0b8a09 from port 0ce85f00-01ff-4d38-89a7-beb1609b7e9a Aug 24 19:36:02.932421 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-14fb0a84-9953-4c0e-9206-208170cc3a13 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "POST /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/action" status: 202 len: 0 microversion: 2.1 time: 0.545158 Aug 24 19:36:02.933914 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 490/993] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:02 2021] POST /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:03.027068 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ae727cd1-5c52-4b46-8135-e51d46566f0d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:03.028932 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ae727cd1-5c52-4b46-8135-e51d46566f0d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:03.041546 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ae727cd1-5c52-4b46-8135-e51d46566f0d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:03.042402 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ae727cd1-5c52-4b46-8135-e51d46566f0d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:03.044690 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ae727cd1-5c52-4b46-8135-e51d46566f0d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:03.046061 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ae727cd1-5c52-4b46-8135-e51d46566f0d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:03.157596 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ae727cd1-5c52-4b46-8135-e51d46566f0d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 27274 microversion: 2.20 time: 0.134691 Aug 24 19:36:03.159121 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 491/994] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:03 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 27274 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:36:03.165219 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-29a9ed02-0bd0-4404-ac68-c5205e628a69 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:03.166464 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-29a9ed02-0bd0-4404-ac68-c5205e628a69 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:03.177221 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-29a9ed02-0bd0-4404-ac68-c5205e628a69 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:03.177674 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-29a9ed02-0bd0-4404-ac68-c5205e628a69 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:03.178448 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-29a9ed02-0bd0-4404-ac68-c5205e628a69 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:03.179051 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-29a9ed02-0bd0-4404-ac68-c5205e628a69 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:03.241271 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-233f6cc2-9151-4058-ac90-0aea60bb3eb3 req-bc4b2f8f-87de-4e76-a6ae-b3bd06fe8bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2057e6ea-d98d-4233-b304-42ed12ce391c", "tag": "0ce85f00-01ff-4d38-89a7-beb1609b7e9a"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:03.241271 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:36:03.241271 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:36:03.241271 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-233f6cc2-9151-4058-ac90-0aea60bb3eb3 req-bc4b2f8f-87de-4e76-a6ae-b3bd06fe8bee service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:03.241271 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-233f6cc2-9151-4058-ac90-0aea60bb3eb3 req-bc4b2f8f-87de-4e76-a6ae-b3bd06fe8bee service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:03.252133 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-233f6cc2-9151-4058-ac90-0aea60bb3eb3 req-bc4b2f8f-87de-4e76-a6ae-b3bd06fe8bee service nova] Creating event network-changed:0ce85f00-01ff-4d38-89a7-beb1609b7e9a for instance 2057e6ea-d98d-4233-b304-42ed12ce391c on hv-cinder-79819 Aug 24 19:36:03.257000 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-233f6cc2-9151-4058-ac90-0aea60bb3eb3 req-bc4b2f8f-87de-4e76-a6ae-b3bd06fe8bee service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.314382 Aug 24 19:36:03.257596 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 504/995] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:36:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:36:03.266259 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-29a9ed02-0bd0-4404-ac68-c5205e628a69 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 28647 microversion: 2.1 time: 0.105554 Aug 24 19:36:03.266910 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 492/996] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:03 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 28647 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:36:04.171115 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6b46e13d-fb60-4cb6-97e0-6a31da610246 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:04.172093 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6b46e13d-fb60-4cb6-97e0-6a31da610246 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:04.179227 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6b46e13d-fb60-4cb6-97e0-6a31da610246 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:04.179227 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6b46e13d-fb60-4cb6-97e0-6a31da610246 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:04.180025 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6b46e13d-fb60-4cb6-97e0-6a31da610246 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:04.180361 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6b46e13d-fb60-4cb6-97e0-6a31da610246 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:04.214035 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-fe522706-8297-4ebd-aeda-f5a994ce7eec tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:04.214605 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-fe522706-8297-4ebd-aeda-f5a994ce7eec tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:04.221127 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fe522706-8297-4ebd-aeda-f5a994ce7eec tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:04.221597 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fe522706-8297-4ebd-aeda-f5a994ce7eec tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:04.222900 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fe522706-8297-4ebd-aeda-f5a994ce7eec tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:04.223295 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fe522706-8297-4ebd-aeda-f5a994ce7eec tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:04.265732 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6b46e13d-fb60-4cb6-97e0-6a31da610246 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 27806 microversion: 2.20 time: 0.098993 Aug 24 19:36:04.268276 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 505/997] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:04 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 27806 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:04.281436 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-db204c1a-53ba-4fde-bb2c-3deb0361a9a1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:04.282651 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-db204c1a-53ba-4fde-bb2c-3deb0361a9a1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:04.290857 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-db204c1a-53ba-4fde-bb2c-3deb0361a9a1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:04.291689 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-db204c1a-53ba-4fde-bb2c-3deb0361a9a1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:04.292494 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-db204c1a-53ba-4fde-bb2c-3deb0361a9a1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:04.292917 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-db204c1a-53ba-4fde-bb2c-3deb0361a9a1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:04.324771 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.objects.instance [None req-fe522706-8297-4ebd-aeda-f5a994ce7eec tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lazy-loading 'services' on Instance uuid 2057e6ea-d98d-4233-b304-42ed12ce391c {{(pid=108908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:36:04.373296 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-db204c1a-53ba-4fde-bb2c-3deb0361a9a1 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 28647 microversion: 2.1 time: 0.097785 Aug 24 19:36:04.374509 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 506/998] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:04 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 28647 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:36:04.560611 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-fe522706-8297-4ebd-aeda-f5a994ce7eec tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/os-volume_attachments/d278094e-49ee-43d8-a17e-3cb1f9cb1774" status: 202 len: 0 microversion: 2.1 time: 0.350449 Aug 24 19:36:04.561436 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 493/999] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 24 19:36:04 2021] DELETE /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/os-volume_attachments/d278094e-49ee-43d8-a17e-3cb1f9cb1774 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:36:04.570077 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-63990324-c745-4e30-9eac-1dbe667e2fb0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:04.573846 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-63990324-c745-4e30-9eac-1dbe667e2fb0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:04.578217 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-63990324-c745-4e30-9eac-1dbe667e2fb0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:04.578603 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-63990324-c745-4e30-9eac-1dbe667e2fb0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:04.579370 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-63990324-c745-4e30-9eac-1dbe667e2fb0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:04.579791 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-63990324-c745-4e30-9eac-1dbe667e2fb0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:04.609736 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-63990324-c745-4e30-9eac-1dbe667e2fb0 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043713 Aug 24 19:36:04.610480 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 507/1000] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:36:04 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:36:05.272889 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-6fe7ce1e-a657-4c11-9cb9-4a8aecd7a751 req-91b1605c-670e-47b9-8cee-567d7dc41a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2057e6ea-d98d-4233-b304-42ed12ce391c", "tag": "0ce85f00-01ff-4d38-89a7-beb1609b7e9a"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:05.274793 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:36:05.274793 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:36:05.278507 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7a277d54-c6d3-4576-9ccc-94fe7a9664da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:05.279410 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7a277d54-c6d3-4576-9ccc-94fe7a9664da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:05.282635 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-6fe7ce1e-a657-4c11-9cb9-4a8aecd7a751 req-91b1605c-670e-47b9-8cee-567d7dc41a99 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:05.283074 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-6fe7ce1e-a657-4c11-9cb9-4a8aecd7a751 req-91b1605c-670e-47b9-8cee-567d7dc41a99 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:05.285470 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a277d54-c6d3-4576-9ccc-94fe7a9664da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:05.286592 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a277d54-c6d3-4576-9ccc-94fe7a9664da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:05.287353 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a277d54-c6d3-4576-9ccc-94fe7a9664da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:05.287777 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a277d54-c6d3-4576-9ccc-94fe7a9664da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:05.294913 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-6fe7ce1e-a657-4c11-9cb9-4a8aecd7a751 req-91b1605c-670e-47b9-8cee-567d7dc41a99 service nova] Creating event network-changed:0ce85f00-01ff-4d38-89a7-beb1609b7e9a for instance 2057e6ea-d98d-4233-b304-42ed12ce391c on hv-cinder-79819 Aug 24 19:36:05.300975 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-6fe7ce1e-a657-4c11-9cb9-4a8aecd7a751 req-91b1605c-670e-47b9-8cee-567d7dc41a99 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032648 Aug 24 19:36:05.301574 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 494/1001] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:36:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:36:05.376471 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7a277d54-c6d3-4576-9ccc-94fe7a9664da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 28161 microversion: 2.20 time: 0.101689 Aug 24 19:36:05.377144 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 508/1002] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:05 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 28161 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:36:05.385363 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d212acbc-9ddc-403e-b5d0-79dad1007c55 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:05.386359 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d212acbc-9ddc-403e-b5d0-79dad1007c55 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:05.392594 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d212acbc-9ddc-403e-b5d0-79dad1007c55 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:05.393050 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d212acbc-9ddc-403e-b5d0-79dad1007c55 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:05.393824 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d212acbc-9ddc-403e-b5d0-79dad1007c55 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:05.394258 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d212acbc-9ddc-403e-b5d0-79dad1007c55 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:05.423965 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-00541748-2cf8-461e-b932-6c55f89841d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:05.424563 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-00541748-2cf8-461e-b932-6c55f89841d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:05.432339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-00541748-2cf8-461e-b932-6c55f89841d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:05.432716 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-00541748-2cf8-461e-b932-6c55f89841d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:05.433481 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-00541748-2cf8-461e-b932-6c55f89841d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:05.433902 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-00541748-2cf8-461e-b932-6c55f89841d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:05.470608 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d212acbc-9ddc-403e-b5d0-79dad1007c55 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 28647 microversion: 2.1 time: 0.089097 Aug 24 19:36:05.471438 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 495/1003] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:05 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 28647 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:36:05.519729 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-00541748-2cf8-461e-b932-6c55f89841d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lazy-loading 'services' on Instance uuid 912de8e3-51dc-4fa5-89fd-b59b6c4ef269 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:36:05.622614 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e774836d-1a76-49ab-b6af-b3009e66d5d4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:05.623685 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e774836d-1a76-49ab-b6af-b3009e66d5d4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:05.631189 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e774836d-1a76-49ab-b6af-b3009e66d5d4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:05.631732 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e774836d-1a76-49ab-b6af-b3009e66d5d4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:05.632609 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e774836d-1a76-49ab-b6af-b3009e66d5d4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:05.633633 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e774836d-1a76-49ab-b6af-b3009e66d5d4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:05.664506 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e774836d-1a76-49ab-b6af-b3009e66d5d4 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046455 Aug 24 19:36:05.670165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 496/1004] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:36:05 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:36:05.766808 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-00541748-2cf8-461e-b932-6c55f89841d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "DELETE /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269/os-volume_attachments/c8fae7c0-9bd8-40d9-b162-acc062705eb2" status: 202 len: 0 microversion: 2.1 time: 0.346643 Aug 24 19:36:05.767578 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 509/1005] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 24 19:36:05 2021] DELETE /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269/os-volume_attachments/c8fae7c0-9bd8-40d9-b162-acc062705eb2 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:36:06.388049 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3f92d68d-e449-4cba-8d39-bade3f1b6776 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:06.388906 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3f92d68d-e449-4cba-8d39-bade3f1b6776 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:06.394680 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3f92d68d-e449-4cba-8d39-bade3f1b6776 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:06.395123 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3f92d68d-e449-4cba-8d39-bade3f1b6776 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:06.395884 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3f92d68d-e449-4cba-8d39-bade3f1b6776 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:06.396330 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3f92d68d-e449-4cba-8d39-bade3f1b6776 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:06.483062 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5cc57dff-2d6f-440d-9536-f426c0d7b8fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:06.484046 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5cc57dff-2d6f-440d-9536-f426c0d7b8fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:06.484640 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3f92d68d-e449-4cba-8d39-bade3f1b6776 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 28223 microversion: 2.20 time: 0.100134 Aug 24 19:36:06.485995 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 497/1006] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:06 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 28223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:06.491253 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5cc57dff-2d6f-440d-9536-f426c0d7b8fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:06.491686 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5cc57dff-2d6f-440d-9536-f426c0d7b8fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:06.492455 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5cc57dff-2d6f-440d-9536-f426c0d7b8fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:06.492877 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5cc57dff-2d6f-440d-9536-f426c0d7b8fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:06.561150 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5cc57dff-2d6f-440d-9536-f426c0d7b8fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 28647 microversion: 2.1 time: 0.081863 Aug 24 19:36:06.562046 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 510/1007] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:06 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 28647 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:36:06.675947 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-dfbfc6c8-00c6-44c0-b710-2cffe4c35951 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:06.676880 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-dfbfc6c8-00c6-44c0-b710-2cffe4c35951 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:06.684053 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfbfc6c8-00c6-44c0-b710-2cffe4c35951 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:06.684526 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfbfc6c8-00c6-44c0-b710-2cffe4c35951 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:06.685295 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfbfc6c8-00c6-44c0-b710-2cffe4c35951 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:06.685725 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfbfc6c8-00c6-44c0-b710-2cffe4c35951 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:06.713441 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-dfbfc6c8-00c6-44c0-b710-2cffe4c35951 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041819 Aug 24 19:36:06.713988 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 498/1008] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:36:06 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:36:06.730307 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-afecbe31-d525-49f9-9fb3-3fce469c1d78 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:06.730899 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-afecbe31-d525-49f9-9fb3-3fce469c1d78 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:06.737255 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-afecbe31-d525-49f9-9fb3-3fce469c1d78 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:06.737693 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-afecbe31-d525-49f9-9fb3-3fce469c1d78 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:06.738447 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-afecbe31-d525-49f9-9fb3-3fce469c1d78 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:06.738870 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-afecbe31-d525-49f9-9fb3-3fce469c1d78 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:06.820015 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-afecbe31-d525-49f9-9fb3-3fce469c1d78 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] HTTP exception thrown: Instance 2057e6ea-d98d-4233-b304-42ed12ce391c is not attached to volume d278094e-49ee-43d8-a17e-3cb1f9cb1774 Aug 24 19:36:06.820830 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-afecbe31-d525-49f9-9fb3-3fce469c1d78 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Returning 404 to user: Instance 2057e6ea-d98d-4233-b304-42ed12ce391c is not attached to volume d278094e-49ee-43d8-a17e-3cb1f9cb1774 {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:36:06.821917 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-afecbe31-d525-49f9-9fb3-3fce469c1d78 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/os-volume_attachments/d278094e-49ee-43d8-a17e-3cb1f9cb1774" status: 404 len: 154 microversion: 2.1 time: 0.095762 Aug 24 19:36:06.822486 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 511/1009] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 24 19:36:06 2021] DELETE /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c/os-volume_attachments/d278094e-49ee-43d8-a17e-3cb1f9cb1774 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:36:06.892992 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1fb4094b-96c9-4cff-92c4-dbe2dd7d1f76 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:06.893482 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1fb4094b-96c9-4cff-92c4-dbe2dd7d1f76 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:06.900257 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1fb4094b-96c9-4cff-92c4-dbe2dd7d1f76 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:06.900721 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1fb4094b-96c9-4cff-92c4-dbe2dd7d1f76 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:06.901491 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1fb4094b-96c9-4cff-92c4-dbe2dd7d1f76 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:06.901922 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1fb4094b-96c9-4cff-92c4-dbe2dd7d1f76 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:06.928908 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1fb4094b-96c9-4cff-92c4-dbe2dd7d1f76 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Going to try to terminate instance {{(pid=108908) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:36:07.371829 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1fb4094b-96c9-4cff-92c4-dbe2dd7d1f76 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "DELETE /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 204 len: 0 microversion: 2.1 time: 0.482103 Aug 24 19:36:07.372448 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 499/1010] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:36:06 2021] DELETE /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:36:07.380308 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-20f6b656-e0b3-4cc1-942b-09059e385e67 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:07.390576 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-20f6b656-e0b3-4cc1-942b-09059e385e67 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:07.390576 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-20f6b656-e0b3-4cc1-942b-09059e385e67 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:07.390576 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-20f6b656-e0b3-4cc1-942b-09059e385e67 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:07.390576 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-20f6b656-e0b3-4cc1-942b-09059e385e67 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:07.391011 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-20f6b656-e0b3-4cc1-942b-09059e385e67 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:07.498561 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-66f00ef0-957a-4bdc-ad38-23a72eba26f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:07.499762 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-66f00ef0-957a-4bdc-ad38-23a72eba26f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:07.506233 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-66f00ef0-957a-4bdc-ad38-23a72eba26f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:07.508611 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-66f00ef0-957a-4bdc-ad38-23a72eba26f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:07.508611 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-66f00ef0-957a-4bdc-ad38-23a72eba26f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:07.508611 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-66f00ef0-957a-4bdc-ad38-23a72eba26f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:07.511832 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-20f6b656-e0b3-4cc1-942b-09059e385e67 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:07.519397 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-20f6b656-e0b3-4cc1-942b-09059e385e67 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1514 microversion: 2.1 time: 0.142657 Aug 24 19:36:07.520167 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 512/1011] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:07 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1514 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:07.572816 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-68f5b73e-dff2-40a2-9212-9292eb9c0f37 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:07.573782 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-68f5b73e-dff2-40a2-9212-9292eb9c0f37 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:07.577790 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-66f00ef0-957a-4bdc-ad38-23a72eba26f6 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 28223 microversion: 2.20 time: 0.084100 Aug 24 19:36:07.579598 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 500/1012] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:07 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 28223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:36:07.580163 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-68f5b73e-dff2-40a2-9212-9292eb9c0f37 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:07.580634 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-68f5b73e-dff2-40a2-9212-9292eb9c0f37 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:07.581406 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-68f5b73e-dff2-40a2-9212-9292eb9c0f37 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:07.581830 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-68f5b73e-dff2-40a2-9212-9292eb9c0f37 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:07.645368 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-68f5b73e-dff2-40a2-9212-9292eb9c0f37 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 28647 microversion: 2.1 time: 0.076203 Aug 24 19:36:07.645996 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 513/1013] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:07 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 28647 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:36:08.135164 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4e5690e1-9eb8-4602-a31a-acb81b29e335 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:08.135743 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4e5690e1-9eb8-4602-a31a-acb81b29e335 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:08.142232 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4e5690e1-9eb8-4602-a31a-acb81b29e335 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:08.142673 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4e5690e1-9eb8-4602-a31a-acb81b29e335 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:08.143434 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4e5690e1-9eb8-4602-a31a-acb81b29e335 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:08.143894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4e5690e1-9eb8-4602-a31a-acb81b29e335 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:08.167649 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4e5690e1-9eb8-4602-a31a-acb81b29e335 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Going to try to terminate instance {{(pid=108908) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:36:08.441055 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4e5690e1-9eb8-4602-a31a-acb81b29e335 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 204 len: 0 microversion: 2.1 time: 0.310036 Aug 24 19:36:08.442014 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 501/1014] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:36:08 2021] DELETE /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:36:08.450607 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-04229b0a-90ff-4ca4-b4c1-a6e92951870a tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:08.451292 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-04229b0a-90ff-4ca4-b4c1-a6e92951870a tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:08.457708 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-04229b0a-90ff-4ca4-b4c1-a6e92951870a tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:08.458146 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-04229b0a-90ff-4ca4-b4c1-a6e92951870a tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:08.458895 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-04229b0a-90ff-4ca4-b4c1-a6e92951870a tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:08.459321 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-04229b0a-90ff-4ca4-b4c1-a6e92951870a tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:08.537680 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-96e1ca58-9c4e-4256-9c01-a7b1eda6e998 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:08.538443 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-96e1ca58-9c4e-4256-9c01-a7b1eda6e998 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:08.544380 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-96e1ca58-9c4e-4256-9c01-a7b1eda6e998 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:08.544832 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-96e1ca58-9c4e-4256-9c01-a7b1eda6e998 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:08.545596 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-96e1ca58-9c4e-4256-9c01-a7b1eda6e998 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:08.546025 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-96e1ca58-9c4e-4256-9c01-a7b1eda6e998 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:08.586232 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-04229b0a-90ff-4ca4-b4c1-a6e92951870a tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:08.593708 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-04229b0a-90ff-4ca4-b4c1-a6e92951870a tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1554 microversion: 2.1 time: 0.147041 Aug 24 19:36:08.594269 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 514/1015] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:08 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:08.598773 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c87bc280-8029-48de-8fac-ec7027bc4103 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:08.599656 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c87bc280-8029-48de-8fac-ec7027bc4103 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:08.605453 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c87bc280-8029-48de-8fac-ec7027bc4103 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:08.605889 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c87bc280-8029-48de-8fac-ec7027bc4103 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:08.606642 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c87bc280-8029-48de-8fac-ec7027bc4103 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:08.607067 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c87bc280-8029-48de-8fac-ec7027bc4103 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:08.672055 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-96e1ca58-9c4e-4256-9c01-a7b1eda6e998 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:08.680073 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-96e1ca58-9c4e-4256-9c01-a7b1eda6e998 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1514 microversion: 2.1 time: 0.146441 Aug 24 19:36:08.680657 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 502/1016] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:08 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:36:08.684930 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d5976803-358a-4833-a1e0-e4ed8b82ee3a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:08.685871 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d5976803-358a-4833-a1e0-e4ed8b82ee3a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:08.691483 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d5976803-358a-4833-a1e0-e4ed8b82ee3a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:08.691873 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d5976803-358a-4833-a1e0-e4ed8b82ee3a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:08.692667 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d5976803-358a-4833-a1e0-e4ed8b82ee3a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:08.693120 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d5976803-358a-4833-a1e0-e4ed8b82ee3a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:08.693927 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c87bc280-8029-48de-8fac-ec7027bc4103 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 28514 microversion: 2.20 time: 0.098268 Aug 24 19:36:08.694601 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 515/1017] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:08 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 28514 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:08.768085 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d5976803-358a-4833-a1e0-e4ed8b82ee3a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 29197 microversion: 2.1 time: 0.086211 Aug 24 19:36:08.768800 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 503/1018] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:08 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 29197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:36:09.611223 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5d92e89d-1cf7-45b4-8cd1-3a9d50c1ac91 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:09.611936 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5d92e89d-1cf7-45b4-8cd1-3a9d50c1ac91 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:09.618400 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5d92e89d-1cf7-45b4-8cd1-3a9d50c1ac91 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:09.618866 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5d92e89d-1cf7-45b4-8cd1-3a9d50c1ac91 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:09.619650 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5d92e89d-1cf7-45b4-8cd1-3a9d50c1ac91 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:09.620072 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5d92e89d-1cf7-45b4-8cd1-3a9d50c1ac91 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:09.697573 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-45804856-bc01-4e64-950f-35c0c62038b8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:09.698891 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-45804856-bc01-4e64-950f-35c0c62038b8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:09.708128 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-45804856-bc01-4e64-950f-35c0c62038b8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:09.708128 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-45804856-bc01-4e64-950f-35c0c62038b8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:09.708128 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-45804856-bc01-4e64-950f-35c0c62038b8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:09.708128 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-45804856-bc01-4e64-950f-35c0c62038b8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:09.784132 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-45804856-bc01-4e64-950f-35c0c62038b8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:09.789967 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5d92e89d-1cf7-45b4-8cd1-3a9d50c1ac91 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:09.792855 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-45804856-bc01-4e64-950f-35c0c62038b8 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1472 microversion: 2.1 time: 0.099810 Aug 24 19:36:09.793995 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 504/1019] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:09 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1472 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:36:09.798596 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5d92e89d-1cf7-45b4-8cd1-3a9d50c1ac91 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1554 microversion: 2.1 time: 0.191370 Aug 24 19:36:09.798860 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2b5fcb9f-0cc9-410a-874d-e9b91566073c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:09.799343 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 516/1020] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:09 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1554 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:09.799997 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2b5fcb9f-0cc9-410a-874d-e9b91566073c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:09.805047 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e9db49be-a61a-49c2-bf22-d908a3e6e062 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:09.806428 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e9db49be-a61a-49c2-bf22-d908a3e6e062 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:09.809443 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2b5fcb9f-0cc9-410a-874d-e9b91566073c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:09.809866 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2b5fcb9f-0cc9-410a-874d-e9b91566073c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:09.810845 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2b5fcb9f-0cc9-410a-874d-e9b91566073c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:09.811350 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2b5fcb9f-0cc9-410a-874d-e9b91566073c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:09.813147 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e9db49be-a61a-49c2-bf22-d908a3e6e062 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:09.813594 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e9db49be-a61a-49c2-bf22-d908a3e6e062 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:09.814642 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e9db49be-a61a-49c2-bf22-d908a3e6e062 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:09.816353 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e9db49be-a61a-49c2-bf22-d908a3e6e062 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:09.889075 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2b5fcb9f-0cc9-410a-874d-e9b91566073c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 28565 microversion: 2.20 time: 0.093469 Aug 24 19:36:09.890595 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 505/1021] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:09 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 28565 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:09.905897 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e9db49be-a61a-49c2-bf22-d908a3e6e062 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 30738 microversion: 2.1 time: 0.104747 Aug 24 19:36:09.906927 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 517/1022] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:09 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 30738 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:36:10.006721 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-cd0d61c2-c59b-403f-9687-cbde88ed5535 req-38dcb26f-6e0d-436c-baa1-ddc2d89f3e9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "912de8e3-51dc-4fa5-89fd-b59b6c4ef269", "name": "network-vif-deleted", "tag": "e94ceb52-3b3d-42f2-9e6b-4283c1fbbb3d"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:10.008197 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:36:10.008197 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:36:10.015252 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-cd0d61c2-c59b-403f-9687-cbde88ed5535 req-38dcb26f-6e0d-436c-baa1-ddc2d89f3e9d service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:10.015688 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-cd0d61c2-c59b-403f-9687-cbde88ed5535 req-38dcb26f-6e0d-436c-baa1-ddc2d89f3e9d service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:10.027839 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-cd0d61c2-c59b-403f-9687-cbde88ed5535 req-38dcb26f-6e0d-436c-baa1-ddc2d89f3e9d service nova] Creating event network-vif-deleted:e94ceb52-3b3d-42f2-9e6b-4283c1fbbb3d for instance 912de8e3-51dc-4fa5-89fd-b59b6c4ef269 on hv-cinder-79819 Aug 24 19:36:10.032647 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-cd0d61c2-c59b-403f-9687-cbde88ed5535 req-38dcb26f-6e0d-436c-baa1-ddc2d89f3e9d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031167 Aug 24 19:36:10.033445 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 506/1023] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:36:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:36:10.811174 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7ddb1912-6d4d-4871-84e6-cadae060d7c1 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:10.811789 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7ddb1912-6d4d-4871-84e6-cadae060d7c1 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:10.816561 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-47aec476-c9d8-47e0-bb73-ccc805985912 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:10.817247 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-47aec476-c9d8-47e0-bb73-ccc805985912 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:10.819540 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7ddb1912-6d4d-4871-84e6-cadae060d7c1 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:10.820047 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7ddb1912-6d4d-4871-84e6-cadae060d7c1 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:10.820872 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7ddb1912-6d4d-4871-84e6-cadae060d7c1 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:10.824237 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7ddb1912-6d4d-4871-84e6-cadae060d7c1 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:10.824736 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-47aec476-c9d8-47e0-bb73-ccc805985912 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:10.824736 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-47aec476-c9d8-47e0-bb73-ccc805985912 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:10.825371 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-47aec476-c9d8-47e0-bb73-ccc805985912 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:10.827042 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-47aec476-c9d8-47e0-bb73-ccc805985912 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:10.859894 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7ddb1912-6d4d-4871-84e6-cadae060d7c1 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:10.860359 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7ddb1912-6d4d-4871-84e6-cadae060d7c1 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:10.860810 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-7ddb1912-6d4d-4871-84e6-cadae060d7c1 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lazy-loading 'fault' on Instance uuid 912de8e3-51dc-4fa5-89fd-b59b6c4ef269 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:36:10.925090 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7ddb1912-6d4d-4871-84e6-cadae060d7c1 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:10.938440 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7ddb1912-6d4d-4871-84e6-cadae060d7c1 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 200 len: 1309 microversion: 2.1 time: 0.131403 Aug 24 19:36:10.939355 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 518/1024] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:10 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 1309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:10.944435 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e07a6de9-a0bf-4140-aab4-4ccf5e87beee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:10.945340 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e07a6de9-a0bf-4140-aab4-4ccf5e87beee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:10.951155 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e07a6de9-a0bf-4140-aab4-4ccf5e87beee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:10.951603 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e07a6de9-a0bf-4140-aab4-4ccf5e87beee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:10.952425 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e07a6de9-a0bf-4140-aab4-4ccf5e87beee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:10.952858 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e07a6de9-a0bf-4140-aab4-4ccf5e87beee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:11.012705 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-47aec476-c9d8-47e0-bb73-ccc805985912 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:11.012705 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-47aec476-c9d8-47e0-bb73-ccc805985912 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1554 microversion: 2.1 time: 0.198159 Aug 24 19:36:11.012705 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 507/1025] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:10 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:36:11.017083 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-fde2a9ba-d93e-4259-9e5e-5e90908741bb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:11.018091 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-fde2a9ba-d93e-4259-9e5e-5e90908741bb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:11.025255 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fde2a9ba-d93e-4259-9e5e-5e90908741bb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:11.025907 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fde2a9ba-d93e-4259-9e5e-5e90908741bb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:11.026922 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fde2a9ba-d93e-4259-9e5e-5e90908741bb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:11.027608 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fde2a9ba-d93e-4259-9e5e-5e90908741bb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:11.036670 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e07a6de9-a0bf-4140-aab4-4ccf5e87beee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 28682 microversion: 2.20 time: 0.095903 Aug 24 19:36:11.046792 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 519/1026] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:10 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 28682 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:11.104937 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-fde2a9ba-d93e-4259-9e5e-5e90908741bb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 32374 microversion: 2.1 time: 0.092103 Aug 24 19:36:11.105484 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 508/1027] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:11 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 32374 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:36:11.956317 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c8935c92-77db-4f39-b81a-af52da3b5255 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:11.957123 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c8935c92-77db-4f39-b81a-af52da3b5255 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: 912de8e3-51dc-4fa5-89fd-b59b6c4ef269] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:11.963480 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c8935c92-77db-4f39-b81a-af52da3b5255 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:11.966468 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c8935c92-77db-4f39-b81a-af52da3b5255 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:11.966468 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c8935c92-77db-4f39-b81a-af52da3b5255 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:11.966468 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c8935c92-77db-4f39-b81a-af52da3b5255 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:11.979079 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-c8935c92-77db-4f39-b81a-af52da3b5255 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] HTTP exception thrown: Instance 912de8e3-51dc-4fa5-89fd-b59b6c4ef269 could not be found. Aug 24 19:36:11.979721 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c8935c92-77db-4f39-b81a-af52da3b5255 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Returning 404 to user: Instance 912de8e3-51dc-4fa5-89fd-b59b6c4ef269 could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:36:11.980568 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c8935c92-77db-4f39-b81a-af52da3b5255 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269" status: 404 len: 111 microversion: 2.1 time: 0.028342 Aug 24 19:36:11.981115 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 520/1028] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:11 2021] GET /compute/v2.1/servers/912de8e3-51dc-4fa5-89fd-b59b6c4ef269 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:36:12.028097 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-71a2cffd-625a-4d38-b69e-1f04c498a6c2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:12.028768 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-71a2cffd-625a-4d38-b69e-1f04c498a6c2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:12.035164 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-71a2cffd-625a-4d38-b69e-1f04c498a6c2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:12.035620 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-71a2cffd-625a-4d38-b69e-1f04c498a6c2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:12.036955 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-71a2cffd-625a-4d38-b69e-1f04c498a6c2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:12.037392 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-71a2cffd-625a-4d38-b69e-1f04c498a6c2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:12.047886 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-ddafd5c8-09cb-425f-8749-2f87730c2d86 req-005031b0-647a-4524-816c-1740c9ad15fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2057e6ea-d98d-4233-b304-42ed12ce391c", "name": "network-vif-deleted", "tag": "0ce85f00-01ff-4d38-89a7-beb1609b7e9a"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:12.049602 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:36:12.049602 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:36:12.057167 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-ddafd5c8-09cb-425f-8749-2f87730c2d86 req-005031b0-647a-4524-816c-1740c9ad15fc service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:12.057640 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-ddafd5c8-09cb-425f-8749-2f87730c2d86 req-005031b0-647a-4524-816c-1740c9ad15fc service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:12.068601 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-ddafd5c8-09cb-425f-8749-2f87730c2d86 req-005031b0-647a-4524-816c-1740c9ad15fc service nova] Creating event network-vif-deleted:0ce85f00-01ff-4d38-89a7-beb1609b7e9a for instance 2057e6ea-d98d-4233-b304-42ed12ce391c on hv-cinder-79819 Aug 24 19:36:12.069731 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-71a2cffd-625a-4d38-b69e-1f04c498a6c2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:12.069731 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-71a2cffd-625a-4d38-b69e-1f04c498a6c2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:12.069980 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.objects.instance [None req-71a2cffd-625a-4d38-b69e-1f04c498a6c2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lazy-loading 'fault' on Instance uuid 2057e6ea-d98d-4233-b304-42ed12ce391c {{(pid=108908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:36:12.073421 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-ddafd5c8-09cb-425f-8749-2f87730c2d86 req-005031b0-647a-4524-816c-1740c9ad15fc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029137 Aug 24 19:36:12.074369 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 521/1029] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:36:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:36:12.079490 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b573913a-0691-42bd-aaf3-64a3a2a2087e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:12.080479 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b573913a-0691-42bd-aaf3-64a3a2a2087e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:12.087122 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b573913a-0691-42bd-aaf3-64a3a2a2087e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:12.087577 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b573913a-0691-42bd-aaf3-64a3a2a2087e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:12.088437 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b573913a-0691-42bd-aaf3-64a3a2a2087e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:12.088872 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b573913a-0691-42bd-aaf3-64a3a2a2087e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:12.110231 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-71a2cffd-625a-4d38-b69e-1f04c498a6c2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e9f850bfa8b4266a501e3cff9ae867e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0be9c2c7eb4e229138150d1a78323a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:12.118105 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-71a2cffd-625a-4d38-b69e-1f04c498a6c2 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 200 len: 1348 microversion: 2.1 time: 0.094126 Aug 24 19:36:12.118888 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 509/1030] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:12 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:12.123295 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a3a0b1a0-7e3d-44c2-99ef-eca5757d5104 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:12.124337 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a3a0b1a0-7e3d-44c2-99ef-eca5757d5104 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:12.129989 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a3a0b1a0-7e3d-44c2-99ef-eca5757d5104 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:12.130702 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a3a0b1a0-7e3d-44c2-99ef-eca5757d5104 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:12.131315 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a3a0b1a0-7e3d-44c2-99ef-eca5757d5104 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:12.131746 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a3a0b1a0-7e3d-44c2-99ef-eca5757d5104 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:12.155816 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b573913a-0691-42bd-aaf3-64a3a2a2087e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 28682 microversion: 2.20 time: 0.080069 Aug 24 19:36:12.156819 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 522/1031] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:12 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 28682 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:12.209723 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a3a0b1a0-7e3d-44c2-99ef-eca5757d5104 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 33269 microversion: 2.1 time: 0.089566 Aug 24 19:36:12.210488 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 510/1032] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:12 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 33269 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:36:13.135217 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8ee9d913-951f-4add-9b8b-3138873075e7 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:13.135969 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8ee9d913-951f-4add-9b8b-3138873075e7 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] [instance: 2057e6ea-d98d-4233-b304-42ed12ce391c] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:13.143424 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8ee9d913-951f-4add-9b8b-3138873075e7 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:13.143870 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8ee9d913-951f-4add-9b8b-3138873075e7 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:13.144851 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8ee9d913-951f-4add-9b8b-3138873075e7 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:13.145286 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8ee9d913-951f-4add-9b8b-3138873075e7 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:13.159496 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-8ee9d913-951f-4add-9b8b-3138873075e7 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] HTTP exception thrown: Instance 2057e6ea-d98d-4233-b304-42ed12ce391c could not be found. Aug 24 19:36:13.160074 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8ee9d913-951f-4add-9b8b-3138873075e7 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Returning 404 to user: Instance 2057e6ea-d98d-4233-b304-42ed12ce391c could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:36:13.160938 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8ee9d913-951f-4add-9b8b-3138873075e7 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c" status: 404 len: 111 microversion: 2.1 time: 0.029822 Aug 24 19:36:13.161491 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 523/1033] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:13 2021] GET /compute/v2.1/servers/2057e6ea-d98d-4233-b304-42ed12ce391c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:36:13.167569 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d0d092c2-ffe0-4377-b61a-0b20999d8af0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:13.168564 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d0d092c2-ffe0-4377-b61a-0b20999d8af0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:13.169116 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-627b1f1b-e8a1-4b9b-af13-43455e174465 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] Calling method '.version_select at 0x7f8df7496790>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:13.175172 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d0d092c2-ffe0-4377-b61a-0b20999d8af0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:13.175618 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d0d092c2-ffe0-4377-b61a-0b20999d8af0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:13.176481 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d0d092c2-ffe0-4377-b61a-0b20999d8af0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:13.176921 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d0d092c2-ffe0-4377-b61a-0b20999d8af0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:13.298290 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-627b1f1b-e8a1-4b9b-af13-43455e174465 tempest-TestMinimumBasicScenario-1506333102 tempest-TestMinimumBasicScenario-1506333102-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-634833183" status: 202 len: 0 microversion: 2.1 time: 0.132601 Aug 24 19:36:13.298862 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 524/1034] 10.222.0.59 () {58 vars in 1269 bytes} [Tue Aug 24 19:36:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-634833183 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:36:13.303871 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-745cd3d7-8236-4da5-9097-7c495419a6f8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:13.304644 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-745cd3d7-8236-4da5-9097-7c495419a6f8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:13.310429 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-745cd3d7-8236-4da5-9097-7c495419a6f8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:13.310870 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-745cd3d7-8236-4da5-9097-7c495419a6f8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:13.312829 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-745cd3d7-8236-4da5-9097-7c495419a6f8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:13.312829 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-745cd3d7-8236-4da5-9097-7c495419a6f8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:15.423120 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d0d092c2-ffe0-4377-b61a-0b20999d8af0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 28682 microversion: 2.20 time: 2.259472 Aug 24 19:36:15.424217 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 511/1035] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:13 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 28682 bytes in 2262 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:15.455364 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-745cd3d7-8236-4da5-9097-7c495419a6f8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 36074 microversion: 2.1 time: 2.155174 Aug 24 19:36:15.457990 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 525/1036] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:13 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 36074 bytes in 2157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:36:16.435503 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-7b9b398c-25a5-4b73-aaa2-fc21262966bd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:16.436626 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-7b9b398c-25a5-4b73-aaa2-fc21262966bd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:16.443437 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7b9b398c-25a5-4b73-aaa2-fc21262966bd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:16.443960 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7b9b398c-25a5-4b73-aaa2-fc21262966bd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:16.444828 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7b9b398c-25a5-4b73-aaa2-fc21262966bd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:16.445327 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7b9b398c-25a5-4b73-aaa2-fc21262966bd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:16.469544 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d828cd38-a0c1-4806-bd7a-b77ac36f1f59 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:16.471348 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d828cd38-a0c1-4806-bd7a-b77ac36f1f59 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:16.479774 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d828cd38-a0c1-4806-bd7a-b77ac36f1f59 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:16.481926 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d828cd38-a0c1-4806-bd7a-b77ac36f1f59 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:16.484090 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d828cd38-a0c1-4806-bd7a-b77ac36f1f59 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:16.484923 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d828cd38-a0c1-4806-bd7a-b77ac36f1f59 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:16.541046 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-7b9b398c-25a5-4b73-aaa2-fc21262966bd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 28682 microversion: 2.20 time: 0.109370 Aug 24 19:36:16.544627 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 512/1037] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:16 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 28682 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:16.583314 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d828cd38-a0c1-4806-bd7a-b77ac36f1f59 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 36843 microversion: 2.1 time: 0.119016 Aug 24 19:36:16.584545 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 526/1038] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:16 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 36843 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:36:17.553119 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-91297981-1426-4f9f-9268-c698ac9bef59 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:17.554131 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-91297981-1426-4f9f-9268-c698ac9bef59 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:17.560926 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-91297981-1426-4f9f-9268-c698ac9bef59 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:17.561418 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-91297981-1426-4f9f-9268-c698ac9bef59 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:17.562177 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-91297981-1426-4f9f-9268-c698ac9bef59 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:17.562665 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-91297981-1426-4f9f-9268-c698ac9bef59 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:17.595907 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7f1297f7-7bcb-4e45-8ef6-dc7e15be0df9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:17.596955 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7f1297f7-7bcb-4e45-8ef6-dc7e15be0df9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:17.603997 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7f1297f7-7bcb-4e45-8ef6-dc7e15be0df9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:17.604500 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7f1297f7-7bcb-4e45-8ef6-dc7e15be0df9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:17.605267 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7f1297f7-7bcb-4e45-8ef6-dc7e15be0df9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:17.605694 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7f1297f7-7bcb-4e45-8ef6-dc7e15be0df9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:17.642427 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-91297981-1426-4f9f-9268-c698ac9bef59 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 29259 microversion: 2.20 time: 0.093198 Aug 24 19:36:17.643093 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 513/1039] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:17 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 29259 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:17.685128 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7f1297f7-7bcb-4e45-8ef6-dc7e15be0df9 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 37995 microversion: 2.1 time: 0.093426 Aug 24 19:36:17.685768 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 527/1040] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:17 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 37995 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:36:18.655689 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ee1d27c9-5dc5-46db-9722-ef414063fab1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:18.656866 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ee1d27c9-5dc5-46db-9722-ef414063fab1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:18.663324 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ee1d27c9-5dc5-46db-9722-ef414063fab1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:18.663769 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ee1d27c9-5dc5-46db-9722-ef414063fab1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:18.664567 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ee1d27c9-5dc5-46db-9722-ef414063fab1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:18.664994 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ee1d27c9-5dc5-46db-9722-ef414063fab1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:18.698040 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9443ad7f-2967-4399-b0a2-22c5217c5f3a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:18.699015 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9443ad7f-2967-4399-b0a2-22c5217c5f3a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:18.705702 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9443ad7f-2967-4399-b0a2-22c5217c5f3a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:18.706163 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9443ad7f-2967-4399-b0a2-22c5217c5f3a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:18.706904 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9443ad7f-2967-4399-b0a2-22c5217c5f3a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:18.707328 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9443ad7f-2967-4399-b0a2-22c5217c5f3a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:18.745949 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ee1d27c9-5dc5-46db-9722-ef414063fab1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 31165 microversion: 2.20 time: 0.094141 Aug 24 19:36:18.750358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 514/1041] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:18 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 31165 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:18.786386 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9443ad7f-2967-4399-b0a2-22c5217c5f3a tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 38175 microversion: 2.1 time: 0.092078 Aug 24 19:36:18.790713 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 528/1042] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:18 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 38175 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:36:19.760306 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a06b8b7e-6557-48f3-8130-6f4deff0224f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:19.761380 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a06b8b7e-6557-48f3-8130-6f4deff0224f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:19.768113 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a06b8b7e-6557-48f3-8130-6f4deff0224f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:19.768580 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a06b8b7e-6557-48f3-8130-6f4deff0224f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:19.769344 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a06b8b7e-6557-48f3-8130-6f4deff0224f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:19.769775 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a06b8b7e-6557-48f3-8130-6f4deff0224f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:19.798947 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-30be288f-674e-4161-8cf4-30814821c5dc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:19.800005 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-30be288f-674e-4161-8cf4-30814821c5dc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:19.806847 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-30be288f-674e-4161-8cf4-30814821c5dc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:19.807284 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-30be288f-674e-4161-8cf4-30814821c5dc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:19.808095 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-30be288f-674e-4161-8cf4-30814821c5dc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:19.808547 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-30be288f-674e-4161-8cf4-30814821c5dc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:21.530028 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a06b8b7e-6557-48f3-8130-6f4deff0224f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 34650 microversion: 2.20 time: 1.772696 Aug 24 19:36:21.530028 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 515/1043] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:19 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 34650 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:21.534886 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-30be288f-674e-4161-8cf4-30814821c5dc tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 38175 microversion: 2.1 time: 1.739604 Aug 24 19:36:21.538432 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 529/1044] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:19 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 38175 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:36:22.541047 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a70fb41f-512e-4c7a-b8a8-ecca8b1d668f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:22.542033 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a70fb41f-512e-4c7a-b8a8-ecca8b1d668f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:22.548079 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c0985ae5-2faf-4aa2-8aa8-c3464099bc69 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:22.549114 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c0985ae5-2faf-4aa2-8aa8-c3464099bc69 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:22.549389 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a70fb41f-512e-4c7a-b8a8-ecca8b1d668f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:22.549836 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a70fb41f-512e-4c7a-b8a8-ecca8b1d668f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:22.551634 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a70fb41f-512e-4c7a-b8a8-ecca8b1d668f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:22.552241 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a70fb41f-512e-4c7a-b8a8-ecca8b1d668f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:22.559287 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c0985ae5-2faf-4aa2-8aa8-c3464099bc69 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:22.560365 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c0985ae5-2faf-4aa2-8aa8-c3464099bc69 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:22.561425 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c0985ae5-2faf-4aa2-8aa8-c3464099bc69 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:22.562302 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c0985ae5-2faf-4aa2-8aa8-c3464099bc69 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:22.630761 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a70fb41f-512e-4c7a-b8a8-ecca8b1d668f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 35519 microversion: 2.20 time: 0.093621 Aug 24 19:36:22.631411 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 516/1045] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:22 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 35519 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:22.636155 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-968913984", "imageRef": "9aa64d91-bca1-4177-a86f-bd9af1306ba1", "flavorRef": "452", "networks": [{"uuid": "518d0660-b1d0-41dc-b1d1-9a48109971f0"}]}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:22.641326 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c0985ae5-2faf-4aa2-8aa8-c3464099bc69 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 38184 microversion: 2.1 time: 0.097096 Aug 24 19:36:22.641971 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 530/1046] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:22 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 38184 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:36:22.687952 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.network.neutron [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] validate_networks() for [('518d0660-b1d0-41dc-b1d1-9a48109971f0', None, None, None, None, None)] {{(pid=108908) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:36:23.027010 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Flavor limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:36:23.027524 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Image limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:36:23.028091 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Flavor pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:36:23.028554 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Image pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:36:23.028965 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:36:23.038346 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:23.038791 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:23.039898 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:23.040392 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:23.057153 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Getting quotas for project 557992a6150e4dffb7039761938b1ee5. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:36:23.061102 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Getting quotas for user f2dcc1b5cebb47ba8ed7283904b5775a and project 557992a6150e4dffb7039761938b1ee5. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:36:23.071976 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Going to run 1 instances... {{(pid=108908) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:36:23.074395 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9aa64d91-bca1-4177-a86f-bd9af1306ba1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:36:23.206442 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e1c91d39-7ca3-4740-9211-2db418a52917 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.573458 Aug 24 19:36:23.207149 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 517/1047] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:36:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:36:23.217577 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b1146067-7bbc-4f3a-bf78-bb134d5f8d5b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:23.218390 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b1146067-7bbc-4f3a-bf78-bb134d5f8d5b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:23.277551 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b1146067-7bbc-4f3a-bf78-bb134d5f8d5b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:23.285833 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b1146067-7bbc-4f3a-bf78-bb134d5f8d5b tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1218 microversion: 2.1 time: 0.071748 Aug 24 19:36:23.286402 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 531/1048] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:23 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:23.642957 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-85c06af3-2ee8-4adf-919b-cffbc5dafac2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:23.643979 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-85c06af3-2ee8-4adf-919b-cffbc5dafac2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:23.651618 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-85c06af3-2ee8-4adf-919b-cffbc5dafac2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:23.652061 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-85c06af3-2ee8-4adf-919b-cffbc5dafac2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:23.652877 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-85c06af3-2ee8-4adf-919b-cffbc5dafac2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:23.653268 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-85c06af3-2ee8-4adf-919b-cffbc5dafac2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:23.653428 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-72fea8da-183d-4a2b-8759-22edd6d147fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:23.654488 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-72fea8da-183d-4a2b-8759-22edd6d147fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:23.661422 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-72fea8da-183d-4a2b-8759-22edd6d147fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:23.661986 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-72fea8da-183d-4a2b-8759-22edd6d147fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:23.662793 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-72fea8da-183d-4a2b-8759-22edd6d147fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:23.663290 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-72fea8da-183d-4a2b-8759-22edd6d147fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:23.726024 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-85c06af3-2ee8-4adf-919b-cffbc5dafac2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 37007 microversion: 2.20 time: 0.086829 Aug 24 19:36:23.726804 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 518/1049] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:23 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 37007 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:23.739838 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-72fea8da-183d-4a2b-8759-22edd6d147fb tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action" status: 200 len: 38304 microversion: 2.1 time: 0.089869 Aug 24 19:36:23.745465 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 532/1050] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:23 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/action => generated 38304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 19:36:23.751120 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d893efbc-2a9c-491d-9b9a-b145c27c9c23 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:23.751669 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d893efbc-2a9c-491d-9b9a-b145c27c9c23 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:23.758928 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d893efbc-2a9c-491d-9b9a-b145c27c9c23 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:23.760349 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d893efbc-2a9c-491d-9b9a-b145c27c9c23 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:23.760349 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d893efbc-2a9c-491d-9b9a-b145c27c9c23 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:23.760539 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d893efbc-2a9c-491d-9b9a-b145c27c9c23 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:23.783750 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d893efbc-2a9c-491d-9b9a-b145c27c9c23 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/ips" status: 200 len: 146 microversion: 2.1 time: 0.036718 Aug 24 19:36:23.784374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 519/1051] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 24 19:36:23 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:36:24.303240 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-016efdd7-47c4-45f8-ad37-738330a31c45 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:24.303920 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-016efdd7-47c4-45f8-ad37-738330a31c45 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:24.310305 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-016efdd7-47c4-45f8-ad37-738330a31c45 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:24.310781 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-016efdd7-47c4-45f8-ad37-738330a31c45 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:24.311547 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-016efdd7-47c4-45f8-ad37-738330a31c45 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:24.311975 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-016efdd7-47c4-45f8-ad37-738330a31c45 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:24.370684 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-016efdd7-47c4-45f8-ad37-738330a31c45 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:24.377896 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-016efdd7-47c4-45f8-ad37-738330a31c45 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1222 microversion: 2.1 time: 0.078621 Aug 24 19:36:24.378441 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 533/1052] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:24 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:24.738640 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-70965987-b0eb-4e7d-ac9c-3bd7622bd942 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:24.739578 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-70965987-b0eb-4e7d-ac9c-3bd7622bd942 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:24.745579 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-70965987-b0eb-4e7d-ac9c-3bd7622bd942 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:24.746028 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-70965987-b0eb-4e7d-ac9c-3bd7622bd942 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:24.746797 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-70965987-b0eb-4e7d-ac9c-3bd7622bd942 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:24.747257 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-70965987-b0eb-4e7d-ac9c-3bd7622bd942 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:24.818009 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-70965987-b0eb-4e7d-ac9c-3bd7622bd942 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 38239 microversion: 2.20 time: 0.083502 Aug 24 19:36:24.818646 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 520/1053] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:24 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 38239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:25.395751 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a78a7fcf-1815-4b2a-9c8a-d9dfbd81a531 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:25.396476 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a78a7fcf-1815-4b2a-9c8a-d9dfbd81a531 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:25.403252 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a78a7fcf-1815-4b2a-9c8a-d9dfbd81a531 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:25.403701 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a78a7fcf-1815-4b2a-9c8a-d9dfbd81a531 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:25.404523 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a78a7fcf-1815-4b2a-9c8a-d9dfbd81a531 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:25.404958 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a78a7fcf-1815-4b2a-9c8a-d9dfbd81a531 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:25.468158 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a78a7fcf-1815-4b2a-9c8a-d9dfbd81a531 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:25.476053 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a78a7fcf-1815-4b2a-9c8a-d9dfbd81a531 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1278 microversion: 2.1 time: 0.084483 Aug 24 19:36:25.476749 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 534/1054] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:25 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1278 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:25.568894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-52c1396a-43d3-427e-a35f-99326dcea7e6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87dbf771-29c5-4008-aa97-dbec06fd4a85"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:25.570059 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-52c1396a-43d3-427e-a35f-99326dcea7e6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:25.576821 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52c1396a-43d3-427e-a35f-99326dcea7e6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:25.577269 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52c1396a-43d3-427e-a35f-99326dcea7e6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:25.578029 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52c1396a-43d3-427e-a35f-99326dcea7e6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:25.578456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52c1396a-43d3-427e-a35f-99326dcea7e6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:25.830496 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b9897ee3-c3fa-4f92-b79d-edb11c312819 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:25.832226 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b9897ee3-c3fa-4f92-b79d-edb11c312819 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:25.837930 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b9897ee3-c3fa-4f92-b79d-edb11c312819 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:25.838368 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b9897ee3-c3fa-4f92-b79d-edb11c312819 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:25.839128 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b9897ee3-c3fa-4f92-b79d-edb11c312819 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:25.839573 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b9897ee3-c3fa-4f92-b79d-edb11c312819 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:25.899989 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b9897ee3-c3fa-4f92-b79d-edb11c312819 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 38239 microversion: 2.20 time: 0.073248 Aug 24 19:36:25.904141 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 535/1055] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:25 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 38239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:26.494160 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-69606e67-0601-4cc2-857a-d89bc384a3ca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:26.495954 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-69606e67-0601-4cc2-857a-d89bc384a3ca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:26.501698 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-69606e67-0601-4cc2-857a-d89bc384a3ca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:26.502222 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-69606e67-0601-4cc2-857a-d89bc384a3ca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:26.503072 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-69606e67-0601-4cc2-857a-d89bc384a3ca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:26.504197 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-69606e67-0601-4cc2-857a-d89bc384a3ca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:26.517873 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-52c1396a-43d3-427e-a35f-99326dcea7e6 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.953594 Aug 24 19:36:26.519638 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 521/1056] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 24 19:36:25 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments => generated 194 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:36:26.629890 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-69606e67-0601-4cc2-857a-d89bc384a3ca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:26.637789 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-69606e67-0601-4cc2-857a-d89bc384a3ca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1318 microversion: 2.1 time: 0.147842 Aug 24 19:36:26.644455 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 536/1057] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:26 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:36:26.913098 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6c8889db-0e4f-4538-9623-d7af0f644aa7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:26.914161 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6c8889db-0e4f-4538-9623-d7af0f644aa7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:26.922902 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6c8889db-0e4f-4538-9623-d7af0f644aa7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:26.923707 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6c8889db-0e4f-4538-9623-d7af0f644aa7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:26.924524 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6c8889db-0e4f-4538-9623-d7af0f644aa7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:26.924950 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6c8889db-0e4f-4538-9623-d7af0f644aa7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:26.985297 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6c8889db-0e4f-4538-9623-d7af0f644aa7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 38239 microversion: 2.20 time: 0.077137 Aug 24 19:36:26.985881 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 522/1058] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:26 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 38239 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:27.250156 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-0e923997-585d-4943-a43e-e6378b22d024 req-fb9660e6-0350-44fa-b431-e951af741137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7337890-bb1a-4c01-8ed2-27b83a6f1591", "tag": "5efe7ef9-e185-4bbf-baef-e51bd46803ca"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:27.251632 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:36:27.251632 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:36:27.258490 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-0e923997-585d-4943-a43e-e6378b22d024 req-fb9660e6-0350-44fa-b431-e951af741137 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:27.258928 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-0e923997-585d-4943-a43e-e6378b22d024 req-fb9660e6-0350-44fa-b431-e951af741137 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:27.271258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-0e923997-585d-4943-a43e-e6378b22d024 req-fb9660e6-0350-44fa-b431-e951af741137 service nova] Creating event network-changed:5efe7ef9-e185-4bbf-baef-e51bd46803ca for instance c7337890-bb1a-4c01-8ed2-27b83a6f1591 on hv-cinder-79819 Aug 24 19:36:27.276462 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-0e923997-585d-4943-a43e-e6378b22d024 req-fb9660e6-0350-44fa-b431-e951af741137 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029940 Aug 24 19:36:27.277414 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 537/1059] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:36:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:36:27.656289 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-eb02bb98-05ba-4cee-a246-f556381f94d0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:27.656994 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-eb02bb98-05ba-4cee-a246-f556381f94d0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:27.663600 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-eb02bb98-05ba-4cee-a246-f556381f94d0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:27.664046 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-eb02bb98-05ba-4cee-a246-f556381f94d0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:27.664862 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-eb02bb98-05ba-4cee-a246-f556381f94d0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:27.665291 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-eb02bb98-05ba-4cee-a246-f556381f94d0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:27.793127 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-eb02bb98-05ba-4cee-a246-f556381f94d0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:27.800993 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-eb02bb98-05ba-4cee-a246-f556381f94d0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1318 microversion: 2.1 time: 0.148240 Aug 24 19:36:27.801566 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 523/1060] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:27 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:27.998334 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-65d12237-e375-40d1-aad7-3a92f62b9020 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:27.999369 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-65d12237-e375-40d1-aad7-3a92f62b9020 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:28.006437 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-65d12237-e375-40d1-aad7-3a92f62b9020 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:28.006880 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-65d12237-e375-40d1-aad7-3a92f62b9020 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:28.007631 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-65d12237-e375-40d1-aad7-3a92f62b9020 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:28.008056 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-65d12237-e375-40d1-aad7-3a92f62b9020 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:28.066595 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-65d12237-e375-40d1-aad7-3a92f62b9020 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 38239 microversion: 2.20 time: 0.071529 Aug 24 19:36:28.067202 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 538/1061] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:27 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 38239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:28.817940 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-db95cf99-b1ae-46b8-9c2b-f6a83372de65 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:28.818543 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-db95cf99-b1ae-46b8-9c2b-f6a83372de65 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:28.824900 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-db95cf99-b1ae-46b8-9c2b-f6a83372de65 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:28.825352 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-db95cf99-b1ae-46b8-9c2b-f6a83372de65 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:28.826153 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-db95cf99-b1ae-46b8-9c2b-f6a83372de65 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:28.826593 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-db95cf99-b1ae-46b8-9c2b-f6a83372de65 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:28.945558 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-db95cf99-b1ae-46b8-9c2b-f6a83372de65 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:28.952945 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-db95cf99-b1ae-46b8-9c2b-f6a83372de65 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1318 microversion: 2.1 time: 0.138671 Aug 24 19:36:28.953506 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 524/1062] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:28 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:29.081391 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-52d946ec-0104-438b-ac8e-52a9904c85de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:29.081391 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-52d946ec-0104-438b-ac8e-52a9904c85de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:29.087815 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-52d946ec-0104-438b-ac8e-52a9904c85de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:29.088256 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-52d946ec-0104-438b-ac8e-52a9904c85de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:29.089065 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-52d946ec-0104-438b-ac8e-52a9904c85de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:29.089489 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-52d946ec-0104-438b-ac8e-52a9904c85de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:29.161523 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-52d946ec-0104-438b-ac8e-52a9904c85de tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 200 len: 38382 microversion: 2.20 time: 0.086239 Aug 24 19:36:29.161955 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 539/1063] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:29 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 38382 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:29.172164 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c90e478d-441e-4444-867b-4ca6fb385e00 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:29.172765 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-c90e478d-441e-4444-867b-4ca6fb385e00 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:29.180698 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c90e478d-441e-4444-867b-4ca6fb385e00 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:29.181389 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c90e478d-441e-4444-867b-4ca6fb385e00 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:29.182185 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c90e478d-441e-4444-867b-4ca6fb385e00 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:29.182636 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c90e478d-441e-4444-867b-4ca6fb385e00 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:29.206109 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c90e478d-441e-4444-867b-4ca6fb385e00 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/ips" status: 200 len: 152 microversion: 2.20 time: 0.037561 Aug 24 19:36:29.206683 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 525/1064] 10.222.0.59 () {60 vars in 1289 bytes} [Tue Aug 24 19:36:29 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:36:29.970721 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b8838aef-1c29-4bff-ba80-9d79345863d2 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:29.971399 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b8838aef-1c29-4bff-ba80-9d79345863d2 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:29.978435 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8838aef-1c29-4bff-ba80-9d79345863d2 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:29.978435 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8838aef-1c29-4bff-ba80-9d79345863d2 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:29.979076 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8838aef-1c29-4bff-ba80-9d79345863d2 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:29.979501 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b8838aef-1c29-4bff-ba80-9d79345863d2 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:30.102665 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b8838aef-1c29-4bff-ba80-9d79345863d2 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:30.110108 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b8838aef-1c29-4bff-ba80-9d79345863d2 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1318 microversion: 2.1 time: 0.143337 Aug 24 19:36:30.110673 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 540/1065] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:29 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:31.126337 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c92fdc95-2baf-4075-809a-1cdae484d003 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:31.126943 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-c92fdc95-2baf-4075-809a-1cdae484d003 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:31.134461 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c92fdc95-2baf-4075-809a-1cdae484d003 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:31.134916 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c92fdc95-2baf-4075-809a-1cdae484d003 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:31.135707 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c92fdc95-2baf-4075-809a-1cdae484d003 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:31.136140 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c92fdc95-2baf-4075-809a-1cdae484d003 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:31.262773 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-c92fdc95-2baf-4075-809a-1cdae484d003 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:31.270189 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c92fdc95-2baf-4075-809a-1cdae484d003 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1318 microversion: 2.1 time: 0.147576 Aug 24 19:36:31.270810 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 526/1066] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:31 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:31.852154 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9759acce-10b4-41da-a1ec-960eaa5e7941 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:31.852786 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9759acce-10b4-41da-a1ec-960eaa5e7941 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:31.859523 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9759acce-10b4-41da-a1ec-960eaa5e7941 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:31.860083 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9759acce-10b4-41da-a1ec-960eaa5e7941 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:31.861018 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9759acce-10b4-41da-a1ec-960eaa5e7941 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:31.861514 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9759acce-10b4-41da-a1ec-960eaa5e7941 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:31.886830 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-9759acce-10b4-41da-a1ec-960eaa5e7941 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lazy-loading 'flavor' on Instance uuid df7c8a14-baa7-4787-b6dd-21860c419bda {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:36:32.287410 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-5e7d8a02-2392-4ee0-904b-5c940c81b4d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:32.288022 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-5e7d8a02-2392-4ee0-904b-5c940c81b4d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:32.293938 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5e7d8a02-2392-4ee0-904b-5c940c81b4d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:32.298601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5e7d8a02-2392-4ee0-904b-5c940c81b4d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:32.298601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5e7d8a02-2392-4ee0-904b-5c940c81b4d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:32.298601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-5e7d8a02-2392-4ee0-904b-5c940c81b4d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:32.409252 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9759acce-10b4-41da-a1ec-960eaa5e7941 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 202 len: 0 microversion: 2.20 time: 0.562741 Aug 24 19:36:32.411619 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 541/1067] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:36:31 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:36:32.418983 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7fe224fa-7ffa-4a96-9b77-006092065871 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:32.419660 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7fe224fa-7ffa-4a96-9b77-006092065871 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:32.420088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-5e7d8a02-2392-4ee0-904b-5c940c81b4d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:32.426351 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7fe224fa-7ffa-4a96-9b77-006092065871 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:32.427444 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7fe224fa-7ffa-4a96-9b77-006092065871 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:32.428603 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-5e7d8a02-2392-4ee0-904b-5c940c81b4d6 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1318 microversion: 2.1 time: 0.145027 Aug 24 19:36:32.428737 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7fe224fa-7ffa-4a96-9b77-006092065871 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:32.429044 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7fe224fa-7ffa-4a96-9b77-006092065871 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:32.429343 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 527/1068] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:32 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:36:32.552819 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7fe224fa-7ffa-4a96-9b77-006092065871 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:32.560617 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7fe224fa-7ffa-4a96-9b77-006092065871 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:32.562093 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7fe224fa-7ffa-4a96-9b77-006092065871 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:32.563225 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7fe224fa-7ffa-4a96-9b77-006092065871 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1724 microversion: 2.20 time: 0.148503 Aug 24 19:36:32.563782 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 542/1069] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:32 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:36:33.445520 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d693243f-5908-4aac-b35b-b34d44774ace tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:33.446130 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d693243f-5908-4aac-b35b-b34d44774ace tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:33.451863 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d693243f-5908-4aac-b35b-b34d44774ace tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:33.452361 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d693243f-5908-4aac-b35b-b34d44774ace tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:33.453113 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d693243f-5908-4aac-b35b-b34d44774ace tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:33.453551 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d693243f-5908-4aac-b35b-b34d44774ace tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:33.578146 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d693243f-5908-4aac-b35b-b34d44774ace tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:33.583592 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ff9c619b-5037-4a70-8df4-6f0ea69ccbb9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:33.588514 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ff9c619b-5037-4a70-8df4-6f0ea69ccbb9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:33.588643 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d693243f-5908-4aac-b35b-b34d44774ace tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1318 microversion: 2.1 time: 0.144239 Aug 24 19:36:33.588643 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 528/1070] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:33 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:33.590201 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ff9c619b-5037-4a70-8df4-6f0ea69ccbb9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:33.590635 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ff9c619b-5037-4a70-8df4-6f0ea69ccbb9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:33.591386 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ff9c619b-5037-4a70-8df4-6f0ea69ccbb9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:33.591803 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ff9c619b-5037-4a70-8df4-6f0ea69ccbb9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:33.714533 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ff9c619b-5037-4a70-8df4-6f0ea69ccbb9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:33.722429 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ff9c619b-5037-4a70-8df4-6f0ea69ccbb9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:33.724592 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ff9c619b-5037-4a70-8df4-6f0ea69ccbb9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:33.725721 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ff9c619b-5037-4a70-8df4-6f0ea69ccbb9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1724 microversion: 2.20 time: 0.146637 Aug 24 19:36:33.726278 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 543/1071] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:33 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:33.957373 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-ce99bf67-c406-46b5-ac42-bce88d82bd77 req-2d925fb3-be8c-497a-86fa-ea39d3749137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7337890-bb1a-4c01-8ed2-27b83a6f1591", "name": "network-vif-plugged", "status": "completed", "tag": "5efe7ef9-e185-4bbf-baef-e51bd46803ca"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:33.959467 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:36:33.959467 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:36:33.966412 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-ce99bf67-c406-46b5-ac42-bce88d82bd77 req-2d925fb3-be8c-497a-86fa-ea39d3749137 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:33.966936 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-ce99bf67-c406-46b5-ac42-bce88d82bd77 req-2d925fb3-be8c-497a-86fa-ea39d3749137 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:33.978231 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-ce99bf67-c406-46b5-ac42-bce88d82bd77 req-2d925fb3-be8c-497a-86fa-ea39d3749137 service nova] Creating event network-vif-plugged:5efe7ef9-e185-4bbf-baef-e51bd46803ca for instance c7337890-bb1a-4c01-8ed2-27b83a6f1591 on hv-cinder-79819 Aug 24 19:36:33.983749 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-ce99bf67-c406-46b5-ac42-bce88d82bd77 req-2d925fb3-be8c-497a-86fa-ea39d3749137 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205764 Aug 24 19:36:33.987653 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 529/1072] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:36:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:36:34.068797 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-96da5dd0-4365-4004-b8f6-fc4fb9cf5e6b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:34.069793 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-96da5dd0-4365-4004-b8f6-fc4fb9cf5e6b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:34.076254 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-96da5dd0-4365-4004-b8f6-fc4fb9cf5e6b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:34.076737 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-96da5dd0-4365-4004-b8f6-fc4fb9cf5e6b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:34.077495 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-96da5dd0-4365-4004-b8f6-fc4fb9cf5e6b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:34.077924 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-96da5dd0-4365-4004-b8f6-fc4fb9cf5e6b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:34.107253 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-96da5dd0-4365-4004-b8f6-fc4fb9cf5e6b tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042618 Aug 24 19:36:34.107801 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 544/1073] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:36:34 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:36:34.118287 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-507e4427-df1e-48f9-a826-ddef4a4e1afe tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:34.118861 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-507e4427-df1e-48f9-a826-ddef4a4e1afe tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:34.124894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-507e4427-df1e-48f9-a826-ddef4a4e1afe tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:34.136703 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-507e4427-df1e-48f9-a826-ddef4a4e1afe tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:34.136703 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-507e4427-df1e-48f9-a826-ddef4a4e1afe tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:34.136703 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-507e4427-df1e-48f9-a826-ddef4a4e1afe tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:34.155608 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-507e4427-df1e-48f9-a826-ddef4a4e1afe tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments/87dbf771-29c5-4008-aa97-dbec06fd4a85" status: 200 len: 194 microversion: 2.1 time: 0.041533 Aug 24 19:36:34.156185 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 530/1074] 10.222.0.59 () {58 vars in 1413 bytes} [Tue Aug 24 19:36:34 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments/87dbf771-29c5-4008-aa97-dbec06fd4a85 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:36:34.602892 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-96b0f9d4-90b5-4bd2-9a49-a0f49211a247 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:34.603547 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-96b0f9d4-90b5-4bd2-9a49-a0f49211a247 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:34.609455 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-96b0f9d4-90b5-4bd2-9a49-a0f49211a247 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:34.609901 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-96b0f9d4-90b5-4bd2-9a49-a0f49211a247 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:34.610686 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-96b0f9d4-90b5-4bd2-9a49-a0f49211a247 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:34.611119 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-96b0f9d4-90b5-4bd2-9a49-a0f49211a247 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:34.730627 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-96b0f9d4-90b5-4bd2-9a49-a0f49211a247 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:34.739087 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-96b0f9d4-90b5-4bd2-9a49-a0f49211a247 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1318 microversion: 2.1 time: 0.138963 Aug 24 19:36:34.739957 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 545/1075] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:34 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:34.744572 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8445edaf-8943-4344-bc5f-e47b6dbbd7a7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:34.745182 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8445edaf-8943-4344-bc5f-e47b6dbbd7a7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:34.751350 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8445edaf-8943-4344-bc5f-e47b6dbbd7a7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:34.755443 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8445edaf-8943-4344-bc5f-e47b6dbbd7a7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:34.755443 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8445edaf-8943-4344-bc5f-e47b6dbbd7a7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:34.755443 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8445edaf-8943-4344-bc5f-e47b6dbbd7a7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:34.881259 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8445edaf-8943-4344-bc5f-e47b6dbbd7a7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:34.889137 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8445edaf-8943-4344-bc5f-e47b6dbbd7a7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:34.890657 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8445edaf-8943-4344-bc5f-e47b6dbbd7a7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:34.891727 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8445edaf-8943-4344-bc5f-e47b6dbbd7a7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1724 microversion: 2.20 time: 0.151072 Aug 24 19:36:34.892305 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 531/1076] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:34 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:35.754899 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-67bf6c1e-2937-4102-8c21-52440ac1748d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:35.755502 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-67bf6c1e-2937-4102-8c21-52440ac1748d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:35.761323 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-67bf6c1e-2937-4102-8c21-52440ac1748d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:35.761764 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-67bf6c1e-2937-4102-8c21-52440ac1748d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:35.762524 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-67bf6c1e-2937-4102-8c21-52440ac1748d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:35.762959 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-67bf6c1e-2937-4102-8c21-52440ac1748d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:35.883736 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-67bf6c1e-2937-4102-8c21-52440ac1748d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:35.888986 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0ff3c627-aa6d-4ddc-8b1b-6097b2543a1d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4086ba6-f927-4be7-b5d6-e25fe2401324"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:35.890039 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0ff3c627-aa6d-4ddc-8b1b-6097b2543a1d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:35.891203 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-67bf6c1e-2937-4102-8c21-52440ac1748d tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1508 microversion: 2.1 time: 0.139925 Aug 24 19:36:35.891771 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 546/1077] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:35 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1508 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:35.897299 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0ff3c627-aa6d-4ddc-8b1b-6097b2543a1d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:35.897748 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0ff3c627-aa6d-4ddc-8b1b-6097b2543a1d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:35.898524 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0ff3c627-aa6d-4ddc-8b1b-6097b2543a1d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:35.898957 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0ff3c627-aa6d-4ddc-8b1b-6097b2543a1d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:35.908859 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-cfad8d08-7a91-4a83-8499-4dafe7a24dca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9edc9c35-1113-4720-af4f-06a19034f79c", "device": "/dev/sdb"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:35.910042 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-cfad8d08-7a91-4a83-8499-4dafe7a24dca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:35.916004 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cfad8d08-7a91-4a83-8499-4dafe7a24dca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:35.916476 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cfad8d08-7a91-4a83-8499-4dafe7a24dca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:35.917245 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cfad8d08-7a91-4a83-8499-4dafe7a24dca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:35.917676 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cfad8d08-7a91-4a83-8499-4dafe7a24dca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:36.653269 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0ff3c627-aa6d-4ddc-8b1b-6097b2543a1d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.767777 Aug 24 19:36:36.653876 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 532/1078] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 24 19:36:35 2021] POST /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments => generated 194 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:36:36.659757 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-127182b9-4488-438f-98a8-9ad591a2a17c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:36.660506 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-127182b9-4488-438f-98a8-9ad591a2a17c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:36.666818 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-127182b9-4488-438f-98a8-9ad591a2a17c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:36.667265 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-127182b9-4488-438f-98a8-9ad591a2a17c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:36.668036 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-127182b9-4488-438f-98a8-9ad591a2a17c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:36.668501 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-127182b9-4488-438f-98a8-9ad591a2a17c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:36.682721 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-cfad8d08-7a91-4a83-8499-4dafe7a24dca tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "POST /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.777892 Aug 24 19:36:36.691320 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 547/1079] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Aug 24 19:36:35 2021] POST /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591/os-volume_attachments => generated 194 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:36:36.807073 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-127182b9-4488-438f-98a8-9ad591a2a17c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:36.815147 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-127182b9-4488-438f-98a8-9ad591a2a17c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:36.817335 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-127182b9-4488-438f-98a8-9ad591a2a17c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:36.818514 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-127182b9-4488-438f-98a8-9ad591a2a17c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1724 microversion: 2.20 time: 0.162740 Aug 24 19:36:36.819762 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 533/1080] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:36 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:36.901033 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fdb18286-c556-462f-811f-c018b2dd9a5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:36.901641 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fdb18286-c556-462f-811f-c018b2dd9a5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:36.908168 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fdb18286-c556-462f-811f-c018b2dd9a5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:36.908643 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fdb18286-c556-462f-811f-c018b2dd9a5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:36.909417 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fdb18286-c556-462f-811f-c018b2dd9a5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:36.909847 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fdb18286-c556-462f-811f-c018b2dd9a5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:36.933284 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-fdb18286-c556-462f-811f-c018b2dd9a5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lazy-loading 'flavor' on Instance uuid ff70d818-92c2-45bf-b298-96a45eb576a3 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:36:37.328206 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-fdb18286-c556-462f-811f-c018b2dd9a5d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "POST /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3/action" status: 202 len: 0 microversion: 2.1 time: 0.432694 Aug 24 19:36:37.328811 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 548/1081] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:36 2021] POST /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:37.337626 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-680498d9-79c8-4719-a112-8db7aa29eee9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:37.338369 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-680498d9-79c8-4719-a112-8db7aa29eee9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:37.344545 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-680498d9-79c8-4719-a112-8db7aa29eee9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:37.345029 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-680498d9-79c8-4719-a112-8db7aa29eee9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:37.345842 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-680498d9-79c8-4719-a112-8db7aa29eee9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:37.346279 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-680498d9-79c8-4719-a112-8db7aa29eee9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:37.470869 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-680498d9-79c8-4719-a112-8db7aa29eee9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:37.478297 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-680498d9-79c8-4719-a112-8db7aa29eee9 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1567 microversion: 2.1 time: 0.144548 Aug 24 19:36:37.478865 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 534/1082] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:37 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:36:37.837129 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c34b7102-325b-4c0d-8ac5-72657c8d5e11 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:37.837809 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c34b7102-325b-4c0d-8ac5-72657c8d5e11 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:37.843791 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c34b7102-325b-4c0d-8ac5-72657c8d5e11 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:37.844232 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c34b7102-325b-4c0d-8ac5-72657c8d5e11 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:37.845019 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c34b7102-325b-4c0d-8ac5-72657c8d5e11 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:37.845446 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c34b7102-325b-4c0d-8ac5-72657c8d5e11 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:37.963530 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c34b7102-325b-4c0d-8ac5-72657c8d5e11 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:37.971143 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c34b7102-325b-4c0d-8ac5-72657c8d5e11 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:37.973164 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c34b7102-325b-4c0d-8ac5-72657c8d5e11 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:37.974292 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c34b7102-325b-4c0d-8ac5-72657c8d5e11 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1724 microversion: 2.20 time: 0.141262 Aug 24 19:36:37.974876 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 549/1083] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:37 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1724 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:38.495479 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4ced2a1e-f11b-401a-b9db-d6b8f286e50e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:38.496085 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4ced2a1e-f11b-401a-b9db-d6b8f286e50e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:38.501929 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4ced2a1e-f11b-401a-b9db-d6b8f286e50e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:38.502368 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4ced2a1e-f11b-401a-b9db-d6b8f286e50e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:38.503120 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4ced2a1e-f11b-401a-b9db-d6b8f286e50e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:38.503543 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4ced2a1e-f11b-401a-b9db-d6b8f286e50e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:38.626925 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4ced2a1e-f11b-401a-b9db-d6b8f286e50e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:38.634838 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4ced2a1e-f11b-401a-b9db-d6b8f286e50e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1567 microversion: 2.1 time: 0.142971 Aug 24 19:36:38.635401 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 535/1084] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:38 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:36:38.992571 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ea8de442-3a4e-4662-9fb4-c70e114c601e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:38.993205 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ea8de442-3a4e-4662-9fb4-c70e114c601e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:38.999264 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea8de442-3a4e-4662-9fb4-c70e114c601e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:38.999745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea8de442-3a4e-4662-9fb4-c70e114c601e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:39.000542 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea8de442-3a4e-4662-9fb4-c70e114c601e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:39.000971 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ea8de442-3a4e-4662-9fb4-c70e114c601e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:39.121089 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ea8de442-3a4e-4662-9fb4-c70e114c601e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:39.128779 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ea8de442-3a4e-4662-9fb4-c70e114c601e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:39.130257 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ea8de442-3a4e-4662-9fb4-c70e114c601e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:39.131374 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ea8de442-3a4e-4662-9fb4-c70e114c601e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1724 microversion: 2.20 time: 0.143033 Aug 24 19:36:39.131933 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 550/1085] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:38 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:39.651990 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9a486b68-46f5-4373-b3e7-431ce92efb17 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:39.652621 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9a486b68-46f5-4373-b3e7-431ce92efb17 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:39.658836 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9a486b68-46f5-4373-b3e7-431ce92efb17 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:39.659281 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9a486b68-46f5-4373-b3e7-431ce92efb17 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:39.660041 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9a486b68-46f5-4373-b3e7-431ce92efb17 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:39.660506 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9a486b68-46f5-4373-b3e7-431ce92efb17 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:39.778080 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9a486b68-46f5-4373-b3e7-431ce92efb17 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:39.785401 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9a486b68-46f5-4373-b3e7-431ce92efb17 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1567 microversion: 2.1 time: 0.137132 Aug 24 19:36:39.785965 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 536/1086] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:39 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1567 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:40.149768 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b272d939-a857-4f2c-b1ab-793f5b6658fc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:40.150308 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b272d939-a857-4f2c-b1ab-793f5b6658fc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:40.155773 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b272d939-a857-4f2c-b1ab-793f5b6658fc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:40.156214 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b272d939-a857-4f2c-b1ab-793f5b6658fc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:40.157002 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b272d939-a857-4f2c-b1ab-793f5b6658fc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:40.157429 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b272d939-a857-4f2c-b1ab-793f5b6658fc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:40.275445 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b272d939-a857-4f2c-b1ab-793f5b6658fc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:40.283299 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b272d939-a857-4f2c-b1ab-793f5b6658fc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:40.285332 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b272d939-a857-4f2c-b1ab-793f5b6658fc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:40.286471 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b272d939-a857-4f2c-b1ab-793f5b6658fc tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1724 microversion: 2.20 time: 0.141110 Aug 24 19:36:40.287014 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 551/1087] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:40 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:40.802323 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f492ac26-d83b-4932-89f8-5e5d67c23c8f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:40.802923 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f492ac26-d83b-4932-89f8-5e5d67c23c8f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:40.808801 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f492ac26-d83b-4932-89f8-5e5d67c23c8f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:40.809242 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f492ac26-d83b-4932-89f8-5e5d67c23c8f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:40.810068 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f492ac26-d83b-4932-89f8-5e5d67c23c8f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:40.810496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f492ac26-d83b-4932-89f8-5e5d67c23c8f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:40.932428 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f492ac26-d83b-4932-89f8-5e5d67c23c8f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:40.940781 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f492ac26-d83b-4932-89f8-5e5d67c23c8f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1567 microversion: 2.1 time: 0.142107 Aug 24 19:36:40.942115 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 537/1088] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:40 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:41.305006 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-90c28701-0573-4089-9b23-405685f4fba4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:41.305609 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-90c28701-0573-4089-9b23-405685f4fba4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:41.311653 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-90c28701-0573-4089-9b23-405685f4fba4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:41.312100 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-90c28701-0573-4089-9b23-405685f4fba4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:41.312925 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-90c28701-0573-4089-9b23-405685f4fba4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:41.313412 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-90c28701-0573-4089-9b23-405685f4fba4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:41.430399 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-90c28701-0573-4089-9b23-405685f4fba4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:41.438060 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-90c28701-0573-4089-9b23-405685f4fba4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:41.439522 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-90c28701-0573-4089-9b23-405685f4fba4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:41.440676 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-90c28701-0573-4089-9b23-405685f4fba4 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1724 microversion: 2.20 time: 0.139472 Aug 24 19:36:41.441783 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 552/1089] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:41 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:41.959450 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-34a74f87-b78f-43b4-b26e-584f51836df1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:41.960056 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-34a74f87-b78f-43b4-b26e-584f51836df1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:41.966127 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-34a74f87-b78f-43b4-b26e-584f51836df1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:41.966603 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-34a74f87-b78f-43b4-b26e-584f51836df1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:41.967358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-34a74f87-b78f-43b4-b26e-584f51836df1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:41.967784 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-34a74f87-b78f-43b4-b26e-584f51836df1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:42.087220 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-34a74f87-b78f-43b4-b26e-584f51836df1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:42.094455 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-34a74f87-b78f-43b4-b26e-584f51836df1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1567 microversion: 2.1 time: 0.138561 Aug 24 19:36:42.095021 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 538/1090] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:41 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:42.459362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fa790807-f616-4751-b74a-781dd731f574 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:42.460006 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fa790807-f616-4751-b74a-781dd731f574 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:42.466811 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fa790807-f616-4751-b74a-781dd731f574 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:42.467251 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fa790807-f616-4751-b74a-781dd731f574 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:42.468008 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fa790807-f616-4751-b74a-781dd731f574 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:42.468461 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fa790807-f616-4751-b74a-781dd731f574 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:42.589552 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fa790807-f616-4751-b74a-781dd731f574 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:42.597468 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fa790807-f616-4751-b74a-781dd731f574 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:42.598945 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-fa790807-f616-4751-b74a-781dd731f574 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:42.600160 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-fa790807-f616-4751-b74a-781dd731f574 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1724 microversion: 2.20 time: 0.144821 Aug 24 19:36:42.600773 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 553/1091] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:42 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:43.110665 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-037321d3-7dd0-4770-8723-7f53791260bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:43.111302 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-037321d3-7dd0-4770-8723-7f53791260bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:43.117963 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-037321d3-7dd0-4770-8723-7f53791260bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:43.118412 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-037321d3-7dd0-4770-8723-7f53791260bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:43.119176 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-037321d3-7dd0-4770-8723-7f53791260bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:43.119619 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-037321d3-7dd0-4770-8723-7f53791260bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:43.240641 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-037321d3-7dd0-4770-8723-7f53791260bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:43.248465 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-037321d3-7dd0-4770-8723-7f53791260bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1567 microversion: 2.1 time: 0.141518 Aug 24 19:36:43.254982 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 539/1092] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:43 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:43.617383 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7a91b1f4-5588-4805-96c8-114d15aa4e77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:43.617974 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7a91b1f4-5588-4805-96c8-114d15aa4e77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:43.624211 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a91b1f4-5588-4805-96c8-114d15aa4e77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:43.624676 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a91b1f4-5588-4805-96c8-114d15aa4e77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:43.625426 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a91b1f4-5588-4805-96c8-114d15aa4e77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:43.625848 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a91b1f4-5588-4805-96c8-114d15aa4e77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:43.745296 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7a91b1f4-5588-4805-96c8-114d15aa4e77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:43.752961 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7a91b1f4-5588-4805-96c8-114d15aa4e77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:43.754428 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7a91b1f4-5588-4805-96c8-114d15aa4e77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:43.755558 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7a91b1f4-5588-4805-96c8-114d15aa4e77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1745 microversion: 2.20 time: 0.141920 Aug 24 19:36:43.756106 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 554/1093] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:43 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1745 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:44.265662 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-07df29d2-2650-402e-bb8f-538831a31a12 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:44.266251 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-07df29d2-2650-402e-bb8f-538831a31a12 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:44.273864 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-07df29d2-2650-402e-bb8f-538831a31a12 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:44.274585 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-07df29d2-2650-402e-bb8f-538831a31a12 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:44.275393 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-07df29d2-2650-402e-bb8f-538831a31a12 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:44.276054 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-07df29d2-2650-402e-bb8f-538831a31a12 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:44.398179 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-07df29d2-2650-402e-bb8f-538831a31a12 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:44.405432 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-07df29d2-2650-402e-bb8f-538831a31a12 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1567 microversion: 2.1 time: 0.143384 Aug 24 19:36:44.406004 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 540/1094] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:44 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:44.777194 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c1d8e5b7-cfc2-4ccd-a319-a8214b1c87ac tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:44.778081 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c1d8e5b7-cfc2-4ccd-a319-a8214b1c87ac tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:44.783639 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c1d8e5b7-cfc2-4ccd-a319-a8214b1c87ac tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:44.784100 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c1d8e5b7-cfc2-4ccd-a319-a8214b1c87ac tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:44.784903 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c1d8e5b7-cfc2-4ccd-a319-a8214b1c87ac tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:44.785335 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c1d8e5b7-cfc2-4ccd-a319-a8214b1c87ac tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:44.903047 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c1d8e5b7-cfc2-4ccd-a319-a8214b1c87ac tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:44.910986 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c1d8e5b7-cfc2-4ccd-a319-a8214b1c87ac tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:44.912466 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c1d8e5b7-cfc2-4ccd-a319-a8214b1c87ac tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:44.913607 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c1d8e5b7-cfc2-4ccd-a319-a8214b1c87ac tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1745 microversion: 2.20 time: 0.140219 Aug 24 19:36:44.914177 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 555/1095] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:44 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1745 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:45.226928 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3ad474bb-4d52-4334-a063-a2bac4d54350 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:45.227912 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3ad474bb-4d52-4334-a063-a2bac4d54350 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:45.233811 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3ad474bb-4d52-4334-a063-a2bac4d54350 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:45.234249 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3ad474bb-4d52-4334-a063-a2bac4d54350 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:45.235023 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3ad474bb-4d52-4334-a063-a2bac4d54350 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:45.235449 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3ad474bb-4d52-4334-a063-a2bac4d54350 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:45.265310 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3ad474bb-4d52-4334-a063-a2bac4d54350 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042154 Aug 24 19:36:45.265857 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 541/1096] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:36:45 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:36:45.422790 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1fc2b095-8e44-406f-9da9-a6801b65178d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:45.423345 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1fc2b095-8e44-406f-9da9-a6801b65178d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:45.429950 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1fc2b095-8e44-406f-9da9-a6801b65178d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:45.430393 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1fc2b095-8e44-406f-9da9-a6801b65178d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:45.431156 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1fc2b095-8e44-406f-9da9-a6801b65178d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:45.431586 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1fc2b095-8e44-406f-9da9-a6801b65178d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:45.549483 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1fc2b095-8e44-406f-9da9-a6801b65178d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:45.557469 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1fc2b095-8e44-406f-9da9-a6801b65178d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1567 microversion: 2.1 time: 0.138430 Aug 24 19:36:45.558084 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 556/1097] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:45 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:45.657583 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-89a4987d-cad5-4126-8333-7f110825fe7c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:45.658066 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-89a4987d-cad5-4126-8333-7f110825fe7c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:45.664927 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89a4987d-cad5-4126-8333-7f110825fe7c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:45.665374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89a4987d-cad5-4126-8333-7f110825fe7c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:45.666167 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89a4987d-cad5-4126-8333-7f110825fe7c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:45.666602 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-89a4987d-cad5-4126-8333-7f110825fe7c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:45.697011 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-89a4987d-cad5-4126-8333-7f110825fe7c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments/87dbf771-29c5-4008-aa97-dbec06fd4a85" status: 200 len: 194 microversion: 2.1 time: 0.043075 Aug 24 19:36:45.697627 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 542/1098] 10.222.0.59 () {58 vars in 1413 bytes} [Tue Aug 24 19:36:45 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments/87dbf771-29c5-4008-aa97-dbec06fd4a85 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:36:45.706950 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8d7e63c7-36e7-4351-bd29-ee1b6db01449 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:45.707471 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8d7e63c7-36e7-4351-bd29-ee1b6db01449 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:45.713258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d7e63c7-36e7-4351-bd29-ee1b6db01449 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:45.713697 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d7e63c7-36e7-4351-bd29-ee1b6db01449 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:45.714493 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d7e63c7-36e7-4351-bd29-ee1b6db01449 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:45.714919 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d7e63c7-36e7-4351-bd29-ee1b6db01449 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:45.811847 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-8d7e63c7-36e7-4351-bd29-ee1b6db01449 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lazy-loading 'services' on Instance uuid f86c2b9c-45eb-40fe-a846-982db14d42cd {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:36:45.943642 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3d22ba21-23a2-4c95-b418-28762cbc2dee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:45.943642 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3d22ba21-23a2-4c95-b418-28762cbc2dee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:45.943642 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3d22ba21-23a2-4c95-b418-28762cbc2dee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:45.943642 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3d22ba21-23a2-4c95-b418-28762cbc2dee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:45.944162 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3d22ba21-23a2-4c95-b418-28762cbc2dee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:45.944162 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3d22ba21-23a2-4c95-b418-28762cbc2dee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:46.064822 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3d22ba21-23a2-4c95-b418-28762cbc2dee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:46.073400 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3d22ba21-23a2-4c95-b418-28762cbc2dee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:46.075337 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3d22ba21-23a2-4c95-b418-28762cbc2dee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:46.077408 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3d22ba21-23a2-4c95-b418-28762cbc2dee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1740 microversion: 2.20 time: 0.150297 Aug 24 19:36:46.088435 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 543/1099] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:45 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:36:46.161871 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8d7e63c7-36e7-4351-bd29-ee1b6db01449 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments/87dbf771-29c5-4008-aa97-dbec06fd4a85" status: 202 len: 0 microversion: 2.1 time: 0.458447 Aug 24 19:36:46.162477 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 557/1100] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 24 19:36:45 2021] DELETE /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments/87dbf771-29c5-4008-aa97-dbec06fd4a85 => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:46.574762 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-dfb8fa03-2566-421b-b7fd-80b7fb069ceb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:46.575358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-dfb8fa03-2566-421b-b7fd-80b7fb069ceb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:46.581616 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfb8fa03-2566-421b-b7fd-80b7fb069ceb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:46.582073 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfb8fa03-2566-421b-b7fd-80b7fb069ceb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:46.582860 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfb8fa03-2566-421b-b7fd-80b7fb069ceb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:46.583289 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfb8fa03-2566-421b-b7fd-80b7fb069ceb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:46.724743 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-dfb8fa03-2566-421b-b7fd-80b7fb069ceb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:46.732931 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-dfb8fa03-2566-421b-b7fd-80b7fb069ceb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1567 microversion: 2.1 time: 0.161680 Aug 24 19:36:46.733520 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 544/1101] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:46 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:47.105706 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6956918b-534b-4d49-b854-3765bbd9322f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:47.106633 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6956918b-534b-4d49-b854-3765bbd9322f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:47.116953 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6956918b-534b-4d49-b854-3765bbd9322f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:47.117797 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6956918b-534b-4d49-b854-3765bbd9322f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:47.118775 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6956918b-534b-4d49-b854-3765bbd9322f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:47.119380 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6956918b-534b-4d49-b854-3765bbd9322f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:47.253658 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6956918b-534b-4d49-b854-3765bbd9322f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:47.264984 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6956918b-534b-4d49-b854-3765bbd9322f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:47.266736 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6956918b-534b-4d49-b854-3765bbd9322f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:47.268198 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6956918b-534b-4d49-b854-3765bbd9322f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1740 microversion: 2.20 time: 0.168340 Aug 24 19:36:47.269786 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 558/1102] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:47 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:47.750872 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a7bda8b9-a957-4210-adf9-7ad96c162496 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:47.752094 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a7bda8b9-a957-4210-adf9-7ad96c162496 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:47.762438 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a7bda8b9-a957-4210-adf9-7ad96c162496 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:47.763181 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a7bda8b9-a957-4210-adf9-7ad96c162496 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:47.764482 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a7bda8b9-a957-4210-adf9-7ad96c162496 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:47.765118 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a7bda8b9-a957-4210-adf9-7ad96c162496 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:47.776547 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-b571c8e8-02c4-4d57-a72e-a293e94f3457 req-5488a829-ad0c-488a-9023-98d0f8f451e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7c8a14-baa7-4787-b6dd-21860c419bda", "name": "network-vif-plugged", "status": "completed", "tag": "bdbbbe75-74f7-4905-ad5d-1fc34d1d189b"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:47.779605 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:36:47.779605 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:36:47.791175 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-b571c8e8-02c4-4d57-a72e-a293e94f3457 req-5488a829-ad0c-488a-9023-98d0f8f451e4 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:47.791530 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-b571c8e8-02c4-4d57-a72e-a293e94f3457 req-5488a829-ad0c-488a-9023-98d0f8f451e4 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:47.810986 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-b571c8e8-02c4-4d57-a72e-a293e94f3457 req-5488a829-ad0c-488a-9023-98d0f8f451e4 service nova] Creating event network-vif-plugged:bdbbbe75-74f7-4905-ad5d-1fc34d1d189b for instance df7c8a14-baa7-4787-b6dd-21860c419bda on hv-cinder-79819 Aug 24 19:36:47.820242 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-b571c8e8-02c4-4d57-a72e-a293e94f3457 req-5488a829-ad0c-488a-9023-98d0f8f451e4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057323 Aug 24 19:36:47.821486 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 559/1103] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:36:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:36:47.914429 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a7bda8b9-a957-4210-adf9-7ad96c162496 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:47.929240 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a7bda8b9-a957-4210-adf9-7ad96c162496 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1567 microversion: 2.1 time: 0.182890 Aug 24 19:36:47.930132 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 545/1104] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:47 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:48.291534 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f8038258-2697-4c8a-9850-a4cfa9505928 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:48.292212 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f8038258-2697-4c8a-9850-a4cfa9505928 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:48.298440 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f8038258-2697-4c8a-9850-a4cfa9505928 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:48.298934 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f8038258-2697-4c8a-9850-a4cfa9505928 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:48.302009 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f8038258-2697-4c8a-9850-a4cfa9505928 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:48.303343 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f8038258-2697-4c8a-9850-a4cfa9505928 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:48.472506 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f8038258-2697-4c8a-9850-a4cfa9505928 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:48.480762 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f8038258-2697-4c8a-9850-a4cfa9505928 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:48.482537 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f8038258-2697-4c8a-9850-a4cfa9505928 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:48.483783 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f8038258-2697-4c8a-9850-a4cfa9505928 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1740 microversion: 2.20 time: 0.199147 Aug 24 19:36:48.484656 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 560/1105] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:48 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1740 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:36:48.947296 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a03acee4-22b4-4311-899c-7e14e1bc0681 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:48.948055 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a03acee4-22b4-4311-899c-7e14e1bc0681 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:48.954880 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a03acee4-22b4-4311-899c-7e14e1bc0681 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:48.955358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a03acee4-22b4-4311-899c-7e14e1bc0681 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:48.956824 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a03acee4-22b4-4311-899c-7e14e1bc0681 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:48.957454 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-a03acee4-22b4-4311-899c-7e14e1bc0681 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:49.087244 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a03acee4-22b4-4311-899c-7e14e1bc0681 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:49.095167 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a03acee4-22b4-4311-899c-7e14e1bc0681 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1567 microversion: 2.1 time: 0.151619 Aug 24 19:36:49.103711 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 546/1106] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:48 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:49.502645 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-76d55d43-9ec0-4088-83c8-06d89e093784 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:49.503799 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-76d55d43-9ec0-4088-83c8-06d89e093784 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:49.510166 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-76d55d43-9ec0-4088-83c8-06d89e093784 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:49.510612 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-76d55d43-9ec0-4088-83c8-06d89e093784 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:49.511395 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-76d55d43-9ec0-4088-83c8-06d89e093784 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:49.511833 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-76d55d43-9ec0-4088-83c8-06d89e093784 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:49.641987 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-76d55d43-9ec0-4088-83c8-06d89e093784 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:49.652211 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-76d55d43-9ec0-4088-83c8-06d89e093784 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:49.654143 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-76d55d43-9ec0-4088-83c8-06d89e093784 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:49.656331 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-76d55d43-9ec0-4088-83c8-06d89e093784 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1740 microversion: 2.20 time: 0.156844 Aug 24 19:36:49.657250 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 561/1107] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:49 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:36:50.117142 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-da2462c7-af69-48d6-aaad-a398f91bb0ad tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:50.117759 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-da2462c7-af69-48d6-aaad-a398f91bb0ad tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:50.123762 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-da2462c7-af69-48d6-aaad-a398f91bb0ad tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:50.124454 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-da2462c7-af69-48d6-aaad-a398f91bb0ad tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:50.125475 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-da2462c7-af69-48d6-aaad-a398f91bb0ad tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:50.125913 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-da2462c7-af69-48d6-aaad-a398f91bb0ad tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:50.260795 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-da2462c7-af69-48d6-aaad-a398f91bb0ad tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:50.270374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-da2462c7-af69-48d6-aaad-a398f91bb0ad tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1567 microversion: 2.1 time: 0.161347 Aug 24 19:36:50.272156 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 547/1108] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:50 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:50.676514 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6a05e0b0-d218-4d25-ae5a-28ef5756e3e8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:50.677823 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6a05e0b0-d218-4d25-ae5a-28ef5756e3e8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:50.684355 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6a05e0b0-d218-4d25-ae5a-28ef5756e3e8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:50.684993 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6a05e0b0-d218-4d25-ae5a-28ef5756e3e8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:50.685849 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6a05e0b0-d218-4d25-ae5a-28ef5756e3e8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:50.686375 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6a05e0b0-d218-4d25-ae5a-28ef5756e3e8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:50.848887 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6a05e0b0-d218-4d25-ae5a-28ef5756e3e8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:50.859753 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6a05e0b0-d218-4d25-ae5a-28ef5756e3e8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:50.861538 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6a05e0b0-d218-4d25-ae5a-28ef5756e3e8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:50.863991 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6a05e0b0-d218-4d25-ae5a-28ef5756e3e8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1740 microversion: 2.20 time: 0.191775 Aug 24 19:36:50.886349 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 562/1109] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:50 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:51.290440 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6df27599-dda3-4d37-8967-8322bf703df4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:51.291046 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6df27599-dda3-4d37-8967-8322bf703df4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:51.299739 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6df27599-dda3-4d37-8967-8322bf703df4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:51.300187 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6df27599-dda3-4d37-8967-8322bf703df4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:51.300985 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6df27599-dda3-4d37-8967-8322bf703df4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:51.301604 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6df27599-dda3-4d37-8967-8322bf703df4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:51.452745 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6df27599-dda3-4d37-8967-8322bf703df4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:51.462761 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6df27599-dda3-4d37-8967-8322bf703df4 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1568 microversion: 2.1 time: 0.176577 Aug 24 19:36:51.463584 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 548/1110] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:51 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:51.480239 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-598db961-ac34-4202-b6c7-e02522c3a28b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:51.490885 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-598db961-ac34-4202-b6c7-e02522c3a28b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:51.490885 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-598db961-ac34-4202-b6c7-e02522c3a28b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:51.490885 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-598db961-ac34-4202-b6c7-e02522c3a28b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:51.490885 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-598db961-ac34-4202-b6c7-e02522c3a28b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:51.491269 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-598db961-ac34-4202-b6c7-e02522c3a28b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:51.825861 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-598db961-ac34-4202-b6c7-e02522c3a28b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "POST /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3/action" status: 202 len: 0 microversion: 2.1 time: 0.348861 Aug 24 19:36:51.832337 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 563/1111] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Aug 24 19:36:51 2021] POST /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:51.840735 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f9e67f5f-5915-457d-8e44-515a80a6d06d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:51.841799 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f9e67f5f-5915-457d-8e44-515a80a6d06d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:51.851667 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f9e67f5f-5915-457d-8e44-515a80a6d06d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:51.852450 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f9e67f5f-5915-457d-8e44-515a80a6d06d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:51.853473 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f9e67f5f-5915-457d-8e44-515a80a6d06d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:51.854104 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f9e67f5f-5915-457d-8e44-515a80a6d06d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:51.893961 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-3322a5e2-4266-4c9e-afdd-deee21f620c3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:51.894777 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3322a5e2-4266-4c9e-afdd-deee21f620c3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:51.918087 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3322a5e2-4266-4c9e-afdd-deee21f620c3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:51.922597 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3322a5e2-4266-4c9e-afdd-deee21f620c3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:51.925604 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3322a5e2-4266-4c9e-afdd-deee21f620c3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:51.926285 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3322a5e2-4266-4c9e-afdd-deee21f620c3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:52.055559 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f9e67f5f-5915-457d-8e44-515a80a6d06d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:52.068443 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f9e67f5f-5915-457d-8e44-515a80a6d06d tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1576 microversion: 2.1 time: 0.231371 Aug 24 19:36:52.078613 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 549/1112] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:51 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1576 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:52.166798 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3322a5e2-4266-4c9e-afdd-deee21f620c3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:52.181910 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3322a5e2-4266-4c9e-afdd-deee21f620c3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:52.183266 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3322a5e2-4266-4c9e-afdd-deee21f620c3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:52.184454 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-3322a5e2-4266-4c9e-afdd-deee21f620c3 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1740 microversion: 2.20 time: 0.295496 Aug 24 19:36:52.185362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 564/1113] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:51 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1740 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:36:52.734693 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b5af29bb-658b-4325-a1ed-e7cd10117622 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:52.736035 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b5af29bb-658b-4325-a1ed-e7cd10117622 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:52.742415 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b5af29bb-658b-4325-a1ed-e7cd10117622 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:52.742867 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b5af29bb-658b-4325-a1ed-e7cd10117622 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:52.743653 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b5af29bb-658b-4325-a1ed-e7cd10117622 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:52.744954 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b5af29bb-658b-4325-a1ed-e7cd10117622 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:52.776574 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b5af29bb-658b-4325-a1ed-e7cd10117622 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments/e4086ba6-f927-4be7-b5d6-e25fe2401324" status: 200 len: 194 microversion: 2.1 time: 0.045619 Aug 24 19:36:52.777199 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 550/1114] 10.222.0.59 () {58 vars in 1413 bytes} [Tue Aug 24 19:36:52 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments/e4086ba6-f927-4be7-b5d6-e25fe2401324 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:36:52.787401 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c97d4e0b-ac1f-48bf-83ae-86e900957902 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:52.787905 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c97d4e0b-ac1f-48bf-83ae-86e900957902 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:52.796933 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c97d4e0b-ac1f-48bf-83ae-86e900957902 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:52.797383 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c97d4e0b-ac1f-48bf-83ae-86e900957902 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:52.798180 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c97d4e0b-ac1f-48bf-83ae-86e900957902 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:52.798616 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c97d4e0b-ac1f-48bf-83ae-86e900957902 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:52.892471 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-c97d4e0b-ac1f-48bf-83ae-86e900957902 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lazy-loading 'services' on Instance uuid f86c2b9c-45eb-40fe-a846-982db14d42cd {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:36:53.087265 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-946c135e-d1ba-4dd3-bb01-46d3de8d2ebc tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:53.087796 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-946c135e-d1ba-4dd3-bb01-46d3de8d2ebc tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:53.094758 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-946c135e-d1ba-4dd3-bb01-46d3de8d2ebc tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:53.095275 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-946c135e-d1ba-4dd3-bb01-46d3de8d2ebc tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:53.096809 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-946c135e-d1ba-4dd3-bb01-46d3de8d2ebc tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:53.097251 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-946c135e-d1ba-4dd3-bb01-46d3de8d2ebc tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:53.224128 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-946c135e-d1ba-4dd3-bb01-46d3de8d2ebc tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:53.231821 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-946c135e-d1ba-4dd3-bb01-46d3de8d2ebc tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1516 microversion: 2.1 time: 0.148411 Aug 24 19:36:53.232569 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 551/1115] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:53 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:36:53.244027 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f10382b5-10f9-448f-848c-ea0e552caf77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:53.248503 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f10382b5-10f9-448f-848c-ea0e552caf77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:53.250656 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f10382b5-10f9-448f-848c-ea0e552caf77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:53.251104 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f10382b5-10f9-448f-848c-ea0e552caf77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:53.251851 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f10382b5-10f9-448f-848c-ea0e552caf77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:53.252287 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f10382b5-10f9-448f-848c-ea0e552caf77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:53.353705 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c97d4e0b-ac1f-48bf-83ae-86e900957902 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments/e4086ba6-f927-4be7-b5d6-e25fe2401324" status: 202 len: 0 microversion: 2.1 time: 0.570057 Aug 24 19:36:53.354659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 565/1116] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 24 19:36:52 2021] DELETE /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments/e4086ba6-f927-4be7-b5d6-e25fe2401324 => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:36:53.388947 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f10382b5-10f9-448f-848c-ea0e552caf77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:53.397646 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f10382b5-10f9-448f-848c-ea0e552caf77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:53.399804 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f10382b5-10f9-448f-848c-ea0e552caf77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:53.401043 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f10382b5-10f9-448f-848c-ea0e552caf77 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1740 microversion: 2.20 time: 0.160658 Aug 24 19:36:53.416351 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 552/1117] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:53 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:54.251425 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d87f8033-f75f-4be1-aa8e-5a2d409f3363 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:54.252159 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d87f8033-f75f-4be1-aa8e-5a2d409f3363 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:54.258655 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d87f8033-f75f-4be1-aa8e-5a2d409f3363 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:54.259177 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d87f8033-f75f-4be1-aa8e-5a2d409f3363 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:54.260052 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d87f8033-f75f-4be1-aa8e-5a2d409f3363 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:54.260564 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d87f8033-f75f-4be1-aa8e-5a2d409f3363 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:54.391695 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-d87f8033-f75f-4be1-aa8e-5a2d409f3363 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:54.401294 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d87f8033-f75f-4be1-aa8e-5a2d409f3363 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1516 microversion: 2.1 time: 0.154825 Aug 24 19:36:54.401980 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 566/1118] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:54 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:54.418715 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-807b2b0f-133b-4608-8660-0d617b8cd81b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:54.419471 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-807b2b0f-133b-4608-8660-0d617b8cd81b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:54.427599 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-807b2b0f-133b-4608-8660-0d617b8cd81b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:54.428376 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-807b2b0f-133b-4608-8660-0d617b8cd81b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:54.429547 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-807b2b0f-133b-4608-8660-0d617b8cd81b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:54.430275 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-807b2b0f-133b-4608-8660-0d617b8cd81b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:54.581436 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-807b2b0f-133b-4608-8660-0d617b8cd81b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:54.590135 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-807b2b0f-133b-4608-8660-0d617b8cd81b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:54.591869 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-807b2b0f-133b-4608-8660-0d617b8cd81b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:54.593027 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-807b2b0f-133b-4608-8660-0d617b8cd81b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1740 microversion: 2.20 time: 0.178098 Aug 24 19:36:54.601883 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 553/1119] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:54 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:54.817517 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-7d81afd1-8b4f-4280-bdeb-5d0a0625dbe8 req-c90afbde-2e2a-47a2-9535-2415242ea1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff70d818-92c2-45bf-b298-96a45eb576a3", "name": "network-vif-unplugged", "status": "completed", "tag": "9eae3e9d-b91a-4a71-8862-9ab8e3b42579"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:36:54.819212 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:36:54.819212 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:36:54.826524 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-7d81afd1-8b4f-4280-bdeb-5d0a0625dbe8 req-c90afbde-2e2a-47a2-9535-2415242ea1b9 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:54.827687 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-7d81afd1-8b4f-4280-bdeb-5d0a0625dbe8 req-c90afbde-2e2a-47a2-9535-2415242ea1b9 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:54.840914 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.compute.server_external_events [req-7d81afd1-8b4f-4280-bdeb-5d0a0625dbe8 req-c90afbde-2e2a-47a2-9535-2415242ea1b9 service nova] Unable to find a host for instance ff70d818-92c2-45bf-b298-96a45eb576a3. Dropping event network-vif-unplugged {{(pid=108907) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Aug 24 19:36:54.842170 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-7d81afd1-8b4f-4280-bdeb-5d0a0625dbe8 req-c90afbde-2e2a-47a2-9535-2415242ea1b9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029538 Aug 24 19:36:54.843349 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 567/1120] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:36:54 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 19:36:55.420562 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b7f3cf71-6cfd-4127-a910-69363c007bc6 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:55.421286 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b7f3cf71-6cfd-4127-a910-69363c007bc6 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:55.429913 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b7f3cf71-6cfd-4127-a910-69363c007bc6 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:55.430503 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b7f3cf71-6cfd-4127-a910-69363c007bc6 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:55.431319 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b7f3cf71-6cfd-4127-a910-69363c007bc6 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:55.431747 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b7f3cf71-6cfd-4127-a910-69363c007bc6 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:55.573996 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b7f3cf71-6cfd-4127-a910-69363c007bc6 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:55.584472 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b7f3cf71-6cfd-4127-a910-69363c007bc6 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1516 microversion: 2.1 time: 0.167494 Aug 24 19:36:55.586033 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 554/1121] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:55 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:55.612772 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0238e2d5-7872-4296-9982-a5a837c1774e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:55.613639 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0238e2d5-7872-4296-9982-a5a837c1774e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:55.620240 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0238e2d5-7872-4296-9982-a5a837c1774e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:55.621096 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0238e2d5-7872-4296-9982-a5a837c1774e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:55.621886 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0238e2d5-7872-4296-9982-a5a837c1774e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:55.622306 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0238e2d5-7872-4296-9982-a5a837c1774e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:55.760523 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0238e2d5-7872-4296-9982-a5a837c1774e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:55.769673 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0238e2d5-7872-4296-9982-a5a837c1774e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:55.771481 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0238e2d5-7872-4296-9982-a5a837c1774e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:55.772767 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0238e2d5-7872-4296-9982-a5a837c1774e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1740 microversion: 2.20 time: 0.163670 Aug 24 19:36:55.773352 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 568/1122] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:55 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1740 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:56.606679 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-04278904-43f7-4734-81e2-bfe13b240a63 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:56.611946 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-04278904-43f7-4734-81e2-bfe13b240a63 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:56.620468 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-04278904-43f7-4734-81e2-bfe13b240a63 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:56.622533 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-04278904-43f7-4734-81e2-bfe13b240a63 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:56.623321 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-04278904-43f7-4734-81e2-bfe13b240a63 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:56.623752 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-04278904-43f7-4734-81e2-bfe13b240a63 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:56.784647 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-04278904-43f7-4734-81e2-bfe13b240a63 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:56.793528 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-407a7533-09ac-446b-be98-f3d887ad6329 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:56.802804 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-407a7533-09ac-446b-be98-f3d887ad6329 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:56.806396 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-04278904-43f7-4734-81e2-bfe13b240a63 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1518 microversion: 2.1 time: 0.202395 Aug 24 19:36:56.808113 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 555/1123] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:56 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1518 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:56.828041 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-407a7533-09ac-446b-be98-f3d887ad6329 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:56.828530 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-407a7533-09ac-446b-be98-f3d887ad6329 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:56.829322 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-407a7533-09ac-446b-be98-f3d887ad6329 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:56.829754 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-407a7533-09ac-446b-be98-f3d887ad6329 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:56.935390 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1c7d232d-9bb2-406b-be34-0ac91e874841 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:56.936924 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1c7d232d-9bb2-406b-be34-0ac91e874841 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:56.944781 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c7d232d-9bb2-406b-be34-0ac91e874841 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:56.945567 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c7d232d-9bb2-406b-be34-0ac91e874841 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:56.947148 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c7d232d-9bb2-406b-be34-0ac91e874841 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:56.947707 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1c7d232d-9bb2-406b-be34-0ac91e874841 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:56.988580 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1c7d232d-9bb2-406b-be34-0ac91e874841 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057030 Aug 24 19:36:56.989824 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 556/1124] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:36:56 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:36:56.999308 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-407a7533-09ac-446b-be98-f3d887ad6329 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:57.014003 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-407a7533-09ac-446b-be98-f3d887ad6329 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:57.015922 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-407a7533-09ac-446b-be98-f3d887ad6329 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:57.017228 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-407a7533-09ac-446b-be98-f3d887ad6329 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1740 microversion: 2.20 time: 0.229165 Aug 24 19:36:57.018399 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 569/1125] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:56 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:36:57.823579 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-09c56db2-cc4e-4d46-9a3c-92bf3b23d2d5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:57.824203 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-09c56db2-cc4e-4d46-9a3c-92bf3b23d2d5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:57.830028 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-09c56db2-cc4e-4d46-9a3c-92bf3b23d2d5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:57.830469 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-09c56db2-cc4e-4d46-9a3c-92bf3b23d2d5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:57.831219 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-09c56db2-cc4e-4d46-9a3c-92bf3b23d2d5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:57.831692 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-09c56db2-cc4e-4d46-9a3c-92bf3b23d2d5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:57.949559 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-09c56db2-cc4e-4d46-9a3c-92bf3b23d2d5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:57.957586 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-09c56db2-cc4e-4d46-9a3c-92bf3b23d2d5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1518 microversion: 2.1 time: 0.137686 Aug 24 19:36:57.958173 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 557/1126] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:57 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1518 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:58.000631 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-dd73503f-0dca-44db-9959-bff975875098 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:58.001718 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-dd73503f-0dca-44db-9959-bff975875098 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:58.007468 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-dd73503f-0dca-44db-9959-bff975875098 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:58.007903 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-dd73503f-0dca-44db-9959-bff975875098 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:58.008722 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-dd73503f-0dca-44db-9959-bff975875098 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:58.009142 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-dd73503f-0dca-44db-9959-bff975875098 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:58.036315 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-39fcdc05-a951-49d4-a4b2-3cd69426b6fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:58.037146 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-39fcdc05-a951-49d4-a4b2-3cd69426b6fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:58.038444 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-dd73503f-0dca-44db-9959-bff975875098 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041526 Aug 24 19:36:58.038999 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 570/1127] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:36:57 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 19:36:58.042857 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-39fcdc05-a951-49d4-a4b2-3cd69426b6fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:58.043509 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-39fcdc05-a951-49d4-a4b2-3cd69426b6fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:58.044053 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-39fcdc05-a951-49d4-a4b2-3cd69426b6fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:58.044504 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-39fcdc05-a951-49d4-a4b2-3cd69426b6fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:58.148105 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-579d5146-6702-4339-ae4f-7609d82971ee tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:58.149049 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-579d5146-6702-4339-ae4f-7609d82971ee tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:58.154754 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-579d5146-6702-4339-ae4f-7609d82971ee tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:58.155187 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-579d5146-6702-4339-ae4f-7609d82971ee tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:58.155942 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-579d5146-6702-4339-ae4f-7609d82971ee tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:58.156387 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-579d5146-6702-4339-ae4f-7609d82971ee tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:58.166112 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-39fcdc05-a951-49d4-a4b2-3cd69426b6fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:58.174192 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-39fcdc05-a951-49d4-a4b2-3cd69426b6fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:58.175675 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-39fcdc05-a951-49d4-a4b2-3cd69426b6fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:58.176869 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-39fcdc05-a951-49d4-a4b2-3cd69426b6fd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1740 microversion: 2.20 time: 0.144838 Aug 24 19:36:58.177443 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 558/1128] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:58 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1740 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:36:58.184387 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-579d5146-6702-4339-ae4f-7609d82971ee tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040356 Aug 24 19:36:58.184941 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 571/1129] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Aug 24 19:36:58 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 19:36:58.250154 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b97a9020-d9b6-45e6-8302-639a9ce240a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:58.250732 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b97a9020-d9b6-45e6-8302-639a9ce240a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:58.256881 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b97a9020-d9b6-45e6-8302-639a9ce240a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:58.257327 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b97a9020-d9b6-45e6-8302-639a9ce240a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:58.258116 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b97a9020-d9b6-45e6-8302-639a9ce240a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:58.258566 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b97a9020-d9b6-45e6-8302-639a9ce240a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:58.283500 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b97a9020-d9b6-45e6-8302-639a9ce240a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Going to try to terminate instance {{(pid=108908) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:36:58.596078 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b97a9020-d9b6-45e6-8302-639a9ce240a8 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 204 len: 0 microversion: 2.1 time: 0.348727 Aug 24 19:36:58.596694 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 559/1130] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:36:58 2021] DELETE /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:36:58.604570 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-deecd562-2e00-4456-8e43-c8bc49b9372d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:58.605171 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-deecd562-2e00-4456-8e43-c8bc49b9372d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:58.611557 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-deecd562-2e00-4456-8e43-c8bc49b9372d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:58.611999 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-deecd562-2e00-4456-8e43-c8bc49b9372d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:58.612777 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-deecd562-2e00-4456-8e43-c8bc49b9372d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:58.613203 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-deecd562-2e00-4456-8e43-c8bc49b9372d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:58.736732 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-deecd562-2e00-4456-8e43-c8bc49b9372d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:58.743976 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-deecd562-2e00-4456-8e43-c8bc49b9372d tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1674 microversion: 2.1 time: 0.143014 Aug 24 19:36:58.744582 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 572/1131] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:58 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1674 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:58.975615 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3b370c58-c436-46a8-a5f4-904d8c0eb8a5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:58.976343 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3b370c58-c436-46a8-a5f4-904d8c0eb8a5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:58.982295 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3b370c58-c436-46a8-a5f4-904d8c0eb8a5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:58.982740 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3b370c58-c436-46a8-a5f4-904d8c0eb8a5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:58.983500 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3b370c58-c436-46a8-a5f4-904d8c0eb8a5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:58.983927 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3b370c58-c436-46a8-a5f4-904d8c0eb8a5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:59.099855 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3b370c58-c436-46a8-a5f4-904d8c0eb8a5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:59.108838 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3b370c58-c436-46a8-a5f4-904d8c0eb8a5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1518 microversion: 2.1 time: 0.136864 Aug 24 19:36:59.109617 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 560/1132] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:58 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1518 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:36:59.194812 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-0030882e-6aac-43f9-a68c-01f5803bf936 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:59.195339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-0030882e-6aac-43f9-a68c-01f5803bf936 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:59.201188 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0030882e-6aac-43f9-a68c-01f5803bf936 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:59.201661 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0030882e-6aac-43f9-a68c-01f5803bf936 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:59.202408 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0030882e-6aac-43f9-a68c-01f5803bf936 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:59.202834 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-0030882e-6aac-43f9-a68c-01f5803bf936 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:59.322441 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0030882e-6aac-43f9-a68c-01f5803bf936 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:59.330699 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0030882e-6aac-43f9-a68c-01f5803bf936 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:59.332178 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-0030882e-6aac-43f9-a68c-01f5803bf936 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:59.333369 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-0030882e-6aac-43f9-a68c-01f5803bf936 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1740 microversion: 2.20 time: 0.142328 Aug 24 19:36:59.333933 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 573/1133] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:36:59 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1740 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:36:59.760785 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-724000f7-1098-4f17-b2a1-eb7c66a9acda tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:36:59.767704 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-724000f7-1098-4f17-b2a1-eb7c66a9acda tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:36:59.768105 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-724000f7-1098-4f17-b2a1-eb7c66a9acda tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:59.769032 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-724000f7-1098-4f17-b2a1-eb7c66a9acda tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:59.770046 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-724000f7-1098-4f17-b2a1-eb7c66a9acda tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:36:59.770554 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-724000f7-1098-4f17-b2a1-eb7c66a9acda tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:36:59.899223 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-724000f7-1098-4f17-b2a1-eb7c66a9acda tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:36:59.906390 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-724000f7-1098-4f17-b2a1-eb7c66a9acda tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1674 microversion: 2.1 time: 0.149318 Aug 24 19:36:59.906957 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 561/1134] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:36:59 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:00.142859 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c7627572-e5bf-4a8b-8a49-14f9d830acbb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:00.142859 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c7627572-e5bf-4a8b-8a49-14f9d830acbb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:00.142859 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7627572-e5bf-4a8b-8a49-14f9d830acbb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:00.142859 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7627572-e5bf-4a8b-8a49-14f9d830acbb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:00.143697 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7627572-e5bf-4a8b-8a49-14f9d830acbb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:00.143697 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c7627572-e5bf-4a8b-8a49-14f9d830acbb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:00.260384 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c7627572-e5bf-4a8b-8a49-14f9d830acbb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:00.268124 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c7627572-e5bf-4a8b-8a49-14f9d830acbb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1518 microversion: 2.1 time: 0.145348 Aug 24 19:37:00.268720 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 574/1135] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:00 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1518 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:00.351712 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-55606305-00e1-42c1-b92a-d0fe994c772b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:00.352333 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-55606305-00e1-42c1-b92a-d0fe994c772b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:00.358223 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-55606305-00e1-42c1-b92a-d0fe994c772b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:00.358664 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-55606305-00e1-42c1-b92a-d0fe994c772b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:00.359419 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-55606305-00e1-42c1-b92a-d0fe994c772b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:00.359842 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-55606305-00e1-42c1-b92a-d0fe994c772b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:00.481822 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-55606305-00e1-42c1-b92a-d0fe994c772b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:00.489832 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-55606305-00e1-42c1-b92a-d0fe994c772b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:00.491410 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-55606305-00e1-42c1-b92a-d0fe994c772b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:00.492651 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-55606305-00e1-42c1-b92a-d0fe994c772b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1740 microversion: 2.20 time: 0.144595 Aug 24 19:37:00.493217 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 562/1136] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:00 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1740 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:00.924556 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-dca0ee31-bc80-4fe9-8b55-f752e3cceb62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:00.925163 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-dca0ee31-bc80-4fe9-8b55-f752e3cceb62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:00.930994 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-dca0ee31-bc80-4fe9-8b55-f752e3cceb62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:00.931438 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-dca0ee31-bc80-4fe9-8b55-f752e3cceb62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:00.932196 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-dca0ee31-bc80-4fe9-8b55-f752e3cceb62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:00.932650 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-dca0ee31-bc80-4fe9-8b55-f752e3cceb62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:01.061512 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-dca0ee31-bc80-4fe9-8b55-f752e3cceb62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:01.070322 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-dca0ee31-bc80-4fe9-8b55-f752e3cceb62 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1674 microversion: 2.1 time: 0.150146 Aug 24 19:37:01.070840 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 575/1137] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:00 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:01.287387 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-695788a8-5f12-4525-8f12-4e3920ebb8e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:01.287716 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-695788a8-5f12-4525-8f12-4e3920ebb8e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:01.295277 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-695788a8-5f12-4525-8f12-4e3920ebb8e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:01.295766 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-695788a8-5f12-4525-8f12-4e3920ebb8e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:01.296981 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-695788a8-5f12-4525-8f12-4e3920ebb8e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:01.297443 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-695788a8-5f12-4525-8f12-4e3920ebb8e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:01.428176 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-695788a8-5f12-4525-8f12-4e3920ebb8e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:01.435922 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-695788a8-5f12-4525-8f12-4e3920ebb8e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1518 microversion: 2.1 time: 0.152445 Aug 24 19:37:01.436573 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 563/1138] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:01 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:01.510704 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8fbd29e7-3c5e-4a61-9589-e97d19384296 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:01.511291 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8fbd29e7-3c5e-4a61-9589-e97d19384296 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:01.517896 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8fbd29e7-3c5e-4a61-9589-e97d19384296 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:01.522221 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8fbd29e7-3c5e-4a61-9589-e97d19384296 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:01.522221 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8fbd29e7-3c5e-4a61-9589-e97d19384296 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:01.522221 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8fbd29e7-3c5e-4a61-9589-e97d19384296 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:01.640731 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8fbd29e7-3c5e-4a61-9589-e97d19384296 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:01.649288 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8fbd29e7-3c5e-4a61-9589-e97d19384296 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:01.650927 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8fbd29e7-3c5e-4a61-9589-e97d19384296 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:01.652060 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8fbd29e7-3c5e-4a61-9589-e97d19384296 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1722 microversion: 2.20 time: 0.145055 Aug 24 19:37:01.652677 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 576/1139] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:01 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:02.087629 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-cd6df1e2-7617-405b-a7e6-696cb9087933 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:02.088330 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-cd6df1e2-7617-405b-a7e6-696cb9087933 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:02.094380 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cd6df1e2-7617-405b-a7e6-696cb9087933 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:02.094861 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cd6df1e2-7617-405b-a7e6-696cb9087933 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:02.095795 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cd6df1e2-7617-405b-a7e6-696cb9087933 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:02.096327 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cd6df1e2-7617-405b-a7e6-696cb9087933 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:02.233792 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-cd6df1e2-7617-405b-a7e6-696cb9087933 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:02.241551 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-cd6df1e2-7617-405b-a7e6-696cb9087933 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1674 microversion: 2.1 time: 0.157638 Aug 24 19:37:02.242303 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 564/1140] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:02 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:02.453263 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a3ac0772-9145-45b2-963b-1655ae127829 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:02.453967 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a3ac0772-9145-45b2-963b-1655ae127829 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:02.461085 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a3ac0772-9145-45b2-963b-1655ae127829 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:02.461707 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a3ac0772-9145-45b2-963b-1655ae127829 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:02.462505 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a3ac0772-9145-45b2-963b-1655ae127829 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:02.462929 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a3ac0772-9145-45b2-963b-1655ae127829 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:02.671279 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1a71decb-7eaf-45ee-83ae-a33b070d107f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:02.672374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1a71decb-7eaf-45ee-83ae-a33b070d107f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:02.678672 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1a71decb-7eaf-45ee-83ae-a33b070d107f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:02.679200 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1a71decb-7eaf-45ee-83ae-a33b070d107f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:02.679406 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a3ac0772-9145-45b2-963b-1655ae127829 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:02.680146 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1a71decb-7eaf-45ee-83ae-a33b070d107f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:02.680759 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1a71decb-7eaf-45ee-83ae-a33b070d107f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:02.689803 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a3ac0772-9145-45b2-963b-1655ae127829 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.240282 Aug 24 19:37:02.700058 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 577/1141] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:02 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:03.233590 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1a71decb-7eaf-45ee-83ae-a33b070d107f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:03.241932 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1a71decb-7eaf-45ee-83ae-a33b070d107f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:03.244359 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1a71decb-7eaf-45ee-83ae-a33b070d107f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:03.244625 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1a71decb-7eaf-45ee-83ae-a33b070d107f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1722 microversion: 2.20 time: 0.577207 Aug 24 19:37:03.245289 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 565/1142] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:02 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1722 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 19:37:03.257995 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-cbb792a6-776f-4972-af51-f0fae4ab2f7e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:03.258732 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-cbb792a6-776f-4972-af51-f0fae4ab2f7e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:03.264508 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cbb792a6-776f-4972-af51-f0fae4ab2f7e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:03.264958 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cbb792a6-776f-4972-af51-f0fae4ab2f7e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:03.265750 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cbb792a6-776f-4972-af51-f0fae4ab2f7e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:03.266177 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cbb792a6-776f-4972-af51-f0fae4ab2f7e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:03.441490 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-cbb792a6-776f-4972-af51-f0fae4ab2f7e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:03.448878 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-cbb792a6-776f-4972-af51-f0fae4ab2f7e tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1674 microversion: 2.1 time: 0.194726 Aug 24 19:37:03.449601 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 578/1143] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:03 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1674 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:37:03.706821 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4c1de1f1-89c9-497e-886f-c9fab89afb66 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:03.707358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-4c1de1f1-89c9-497e-886f-c9fab89afb66 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:03.713462 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4c1de1f1-89c9-497e-886f-c9fab89afb66 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:03.714142 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4c1de1f1-89c9-497e-886f-c9fab89afb66 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:03.714906 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4c1de1f1-89c9-497e-886f-c9fab89afb66 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:03.715331 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-4c1de1f1-89c9-497e-886f-c9fab89afb66 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:04.021440 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-4c1de1f1-89c9-497e-886f-c9fab89afb66 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:04.030243 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-fe8f7f25-f7a8-4c62-85a3-ba2cd53877e3 req-0f7892d2-97ef-42b2-b0b6-4d46fb6ae07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7c8a14-baa7-4787-b6dd-21860c419bda", "name": "network-vif-unplugged", "status": "completed", "tag": "bdbbbe75-74f7-4905-ad5d-1fc34d1d189b"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:37:04.033309 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:37:04.033309 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:37:04.045779 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4c1de1f1-89c9-497e-886f-c9fab89afb66 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.336078 Aug 24 19:37:04.045779 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 566/1144] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:03 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:04.052418 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-fe8f7f25-f7a8-4c62-85a3-ba2cd53877e3 req-0f7892d2-97ef-42b2-b0b6-4d46fb6ae07e service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:04.053169 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-fe8f7f25-f7a8-4c62-85a3-ba2cd53877e3 req-0f7892d2-97ef-42b2-b0b6-4d46fb6ae07e service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:04.075733 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-fe8f7f25-f7a8-4c62-85a3-ba2cd53877e3 req-0f7892d2-97ef-42b2-b0b6-4d46fb6ae07e service nova] Creating event network-vif-unplugged:bdbbbe75-74f7-4905-ad5d-1fc34d1d189b for instance df7c8a14-baa7-4787-b6dd-21860c419bda on hv-cinder-79819 Aug 24 19:37:04.091438 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-fe8f7f25-f7a8-4c62-85a3-ba2cd53877e3 req-0f7892d2-97ef-42b2-b0b6-4d46fb6ae07e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064585 Aug 24 19:37:04.095613 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 579/1145] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:37:04 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:37:04.115638 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-b3f7d451-4e23-4a2b-a56a-9fb270b1a731 req-0c65c28c-1986-4802-913f-e05e4143ac95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86c2b9c-45eb-40fe-a846-982db14d42cd", "name": "network-vif-deleted", "tag": "bd28ff14-2c6c-49d2-a836-10efaf8f9f5c"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:37:04.117258 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:37:04.117258 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:37:04.134944 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-b3f7d451-4e23-4a2b-a56a-9fb270b1a731 req-0c65c28c-1986-4802-913f-e05e4143ac95 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:04.137374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-b3f7d451-4e23-4a2b-a56a-9fb270b1a731 req-0c65c28c-1986-4802-913f-e05e4143ac95 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:04.154918 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-b3f7d451-4e23-4a2b-a56a-9fb270b1a731 req-0c65c28c-1986-4802-913f-e05e4143ac95 service nova] Creating event network-vif-deleted:bd28ff14-2c6c-49d2-a836-10efaf8f9f5c for instance f86c2b9c-45eb-40fe-a846-982db14d42cd on hv-cinder-79819 Aug 24 19:37:04.161598 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-b3f7d451-4e23-4a2b-a56a-9fb270b1a731 req-0c65c28c-1986-4802-913f-e05e4143ac95 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050942 Aug 24 19:37:04.162194 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 567/1146] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:37:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:37:04.263781 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-757cef5e-419f-4c7b-b69f-1a911b2cf9b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:04.264490 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-757cef5e-419f-4c7b-b69f-1a911b2cf9b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:04.273857 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-757cef5e-419f-4c7b-b69f-1a911b2cf9b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:04.274293 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-757cef5e-419f-4c7b-b69f-1a911b2cf9b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:04.275067 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-757cef5e-419f-4c7b-b69f-1a911b2cf9b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:04.275496 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-757cef5e-419f-4c7b-b69f-1a911b2cf9b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:04.421352 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-757cef5e-419f-4c7b-b69f-1a911b2cf9b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:04.429537 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-757cef5e-419f-4c7b-b69f-1a911b2cf9b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:04.438918 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-757cef5e-419f-4c7b-b69f-1a911b2cf9b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:04.438918 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-757cef5e-419f-4c7b-b69f-1a911b2cf9b5 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1725 microversion: 2.20 time: 0.172571 Aug 24 19:37:04.438918 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 580/1147] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:04 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:04.451186 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6a4888fa-2388-44f1-b4d4-f6c597382979 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c4d2637-4642-437f-8ae9-d926a9e80f72"}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:37:04.452397 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6a4888fa-2388-44f1-b4d4-f6c597382979 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:04.459619 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6a4888fa-2388-44f1-b4d4-f6c597382979 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:04.460409 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6a4888fa-2388-44f1-b4d4-f6c597382979 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:04.461654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6a4888fa-2388-44f1-b4d4-f6c597382979 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:04.462812 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6a4888fa-2388-44f1-b4d4-f6c597382979 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:04.466030 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-3513fd69-dc0a-4214-8b89-874080665171 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:04.466852 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3513fd69-dc0a-4214-8b89-874080665171 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:04.473195 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3513fd69-dc0a-4214-8b89-874080665171 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:04.476716 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3513fd69-dc0a-4214-8b89-874080665171 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:04.476716 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3513fd69-dc0a-4214-8b89-874080665171 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:04.476716 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3513fd69-dc0a-4214-8b89-874080665171 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:04.541707 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3513fd69-dc0a-4214-8b89-874080665171 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3a89d7e4c2040ab814a75c5463d9f2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bcba9a91f5e4855bdf5044613de0321', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:04.550835 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-3513fd69-dc0a-4214-8b89-874080665171 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 200 len: 1322 microversion: 2.1 time: 0.088383 Aug 24 19:37:04.551936 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 581/1148] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:04 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 1322 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:04.556645 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-fb735532-8994-4e96-9ac0-3729a23b05d4 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:04.557140 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-fb735532-8994-4e96-9ac0-3729a23b05d4 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:04.564148 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fb735532-8994-4e96-9ac0-3729a23b05d4 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:04.565060 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fb735532-8994-4e96-9ac0-3729a23b05d4 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:04.565836 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fb735532-8994-4e96-9ac0-3729a23b05d4 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:04.566263 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-fb735532-8994-4e96-9ac0-3729a23b05d4 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:04.651907 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-fb735532-8994-4e96-9ac0-3729a23b05d4 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lazy-loading 'services' on Instance uuid c7337890-bb1a-4c01-8ed2-27b83a6f1591 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:37:04.928954 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-fb735532-8994-4e96-9ac0-3729a23b05d4 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591/os-volume_attachments/9edc9c35-1113-4720-af4f-06a19034f79c" status: 202 len: 0 microversion: 2.1 time: 0.367070 Aug 24 19:37:04.928954 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 582/1149] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Aug 24 19:37:04 2021] DELETE /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591/os-volume_attachments/9edc9c35-1113-4720-af4f-06a19034f79c => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:37:05.060516 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-79e5a9a4-cfe0-4471-a8a7-d8f61aad0478 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:05.060516 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-79e5a9a4-cfe0-4471-a8a7-d8f61aad0478 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:05.063533 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-79e5a9a4-cfe0-4471-a8a7-d8f61aad0478 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:05.063975 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-79e5a9a4-cfe0-4471-a8a7-d8f61aad0478 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:05.064791 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-79e5a9a4-cfe0-4471-a8a7-d8f61aad0478 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:05.065390 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-79e5a9a4-cfe0-4471-a8a7-d8f61aad0478 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:05.206315 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-79e5a9a4-cfe0-4471-a8a7-d8f61aad0478 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:05.214323 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-79e5a9a4-cfe0-4471-a8a7-d8f61aad0478 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.161766 Aug 24 19:37:05.215373 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 583/1150] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:05 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:37:05.567274 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9dc22ef5-a5bd-439b-8d14-0368df081d9c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:05.567914 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9dc22ef5-a5bd-439b-8d14-0368df081d9c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:05.573857 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9dc22ef5-a5bd-439b-8d14-0368df081d9c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:05.574305 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9dc22ef5-a5bd-439b-8d14-0368df081d9c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:05.575376 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9dc22ef5-a5bd-439b-8d14-0368df081d9c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:05.575668 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9dc22ef5-a5bd-439b-8d14-0368df081d9c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:05.590145 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-9dc22ef5-a5bd-439b-8d14-0368df081d9c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] HTTP exception thrown: Instance f86c2b9c-45eb-40fe-a846-982db14d42cd could not be found. Aug 24 19:37:05.590853 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9dc22ef5-a5bd-439b-8d14-0368df081d9c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Returning 404 to user: Instance f86c2b9c-45eb-40fe-a846-982db14d42cd could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:37:05.591746 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9dc22ef5-a5bd-439b-8d14-0368df081d9c tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 404 len: 111 microversion: 2.1 time: 0.028630 Aug 24 19:37:05.596433 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 584/1151] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:05 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 19:37:05.601154 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-cdf6748f-5f2a-4063-aa4d-4f5c75c8f425 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '.version_select at 0x7f8df7496790>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:05.674789 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6a4888fa-2388-44f1-b4d4-f6c597382979 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.227448 Aug 24 19:37:05.675458 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 568/1152] 10.222.0.59 () {62 vars in 1364 bytes} [Tue Aug 24 19:37:04 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/os-volume_attachments => generated 188 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 19:37:05.687704 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-cdf6748f-5f2a-4063-aa4d-4f5c75c8f425 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944946648" status: 202 len: 0 microversion: 2.1 time: 0.090076 Aug 24 19:37:05.688880 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 585/1153] 10.222.0.59 () {58 vars in 1221 bytes} [Tue Aug 24 19:37:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1944946648 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 19:37:05.801699 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-52ed60cc-eccc-4b27-b32b-489810b62d56 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:05.802189 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-52ed60cc-eccc-4b27-b32b-489810b62d56 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:05.812154 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52ed60cc-eccc-4b27-b32b-489810b62d56 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:05.812877 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52ed60cc-eccc-4b27-b32b-489810b62d56 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:05.814319 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52ed60cc-eccc-4b27-b32b-489810b62d56 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:05.814927 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-52ed60cc-eccc-4b27-b32b-489810b62d56 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:06.058914 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b61bf8a8-2a1b-46ae-ba1c-5ff2d5732e62 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:06.059405 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b61bf8a8-2a1b-46ae-ba1c-5ff2d5732e62 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:06.065973 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b61bf8a8-2a1b-46ae-ba1c-5ff2d5732e62 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:06.066601 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b61bf8a8-2a1b-46ae-ba1c-5ff2d5732e62 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:06.072500 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b61bf8a8-2a1b-46ae-ba1c-5ff2d5732e62 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:06.072500 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b61bf8a8-2a1b-46ae-ba1c-5ff2d5732e62 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:06.092206 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b61bf8a8-2a1b-46ae-ba1c-5ff2d5732e62 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Going to try to terminate instance {{(pid=108907) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:37:06.419326 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b61bf8a8-2a1b-46ae-ba1c-5ff2d5732e62 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 204 len: 0 microversion: 2.1 time: 0.363539 Aug 24 19:37:06.420599 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 586/1154] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:37:06 2021] DELETE /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 19:37:06.427744 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-53567c33-b09b-49bb-b1ec-913408f9c36b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:06.428459 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-53567c33-b09b-49bb-b1ec-913408f9c36b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:06.434371 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-53567c33-b09b-49bb-b1ec-913408f9c36b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:06.434810 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-53567c33-b09b-49bb-b1ec-913408f9c36b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:06.435560 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-53567c33-b09b-49bb-b1ec-913408f9c36b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:06.435980 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-53567c33-b09b-49bb-b1ec-913408f9c36b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:06.525443 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-52ed60cc-eccc-4b27-b32b-489810b62d56 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "DELETE /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/os-volume_attachments/0c4d2637-4642-437f-8ae9-d926a9e80f72" status: 202 len: 0 microversion: 2.20 time: 0.727547 Aug 24 19:37:06.526154 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 569/1155] 10.222.0.59 () {60 vars in 1457 bytes} [Tue Aug 24 19:37:05 2021] DELETE /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/os-volume_attachments/0c4d2637-4642-437f-8ae9-d926a9e80f72 => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:37:06.531291 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0be1551e-da9d-4ac6-b684-80bc64bb0067 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:06.532493 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0be1551e-da9d-4ac6-b684-80bc64bb0067 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:06.544300 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0be1551e-da9d-4ac6-b684-80bc64bb0067 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:06.544857 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0be1551e-da9d-4ac6-b684-80bc64bb0067 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:06.545862 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0be1551e-da9d-4ac6-b684-80bc64bb0067 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:06.546811 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0be1551e-da9d-4ac6-b684-80bc64bb0067 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:06.630246 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-53567c33-b09b-49bb-b1ec-913408f9c36b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:06.637598 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-53567c33-b09b-49bb-b1ec-913408f9c36b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.215696 Aug 24 19:37:06.638169 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 587/1156] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:06 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:06.642586 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-32d0882a-15e1-4acf-8600-b78f14f255a2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:37:06.643078 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-32d0882a-15e1-4acf-8600-b78f14f255a2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:06.649085 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-32d0882a-15e1-4acf-8600-b78f14f255a2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:06.649526 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-32d0882a-15e1-4acf-8600-b78f14f255a2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:06.650308 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-32d0882a-15e1-4acf-8600-b78f14f255a2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:06.650726 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-32d0882a-15e1-4acf-8600-b78f14f255a2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:06.690224 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0be1551e-da9d-4ac6-b684-80bc64bb0067 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:06.697866 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0be1551e-da9d-4ac6-b684-80bc64bb0067 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1514 microversion: 2.1 time: 0.170266 Aug 24 19:37:06.698969 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 570/1157] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:06 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:06.917407 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-32d0882a-15e1-4acf-8600-b78f14f255a2 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action" status: 202 len: 0 microversion: 2.20 time: 0.278173 Aug 24 19:37:06.918043 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 588/1158] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Aug 24 19:37:06 2021] POST /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:37:06.926130 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-45de499a-2dd0-4be3-b4ba-8bee4186a0fe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:06.926735 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-45de499a-2dd0-4be3-b4ba-8bee4186a0fe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:06.932869 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-45de499a-2dd0-4be3-b4ba-8bee4186a0fe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:06.933319 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-45de499a-2dd0-4be3-b4ba-8bee4186a0fe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:06.934088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-45de499a-2dd0-4be3-b4ba-8bee4186a0fe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:06.934520 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-45de499a-2dd0-4be3-b4ba-8bee4186a0fe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:07.065094 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-45de499a-2dd0-4be3-b4ba-8bee4186a0fe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:07.072686 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-45de499a-2dd0-4be3-b4ba-8bee4186a0fe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:07.074329 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-45de499a-2dd0-4be3-b4ba-8bee4186a0fe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:07.075471 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-45de499a-2dd0-4be3-b4ba-8bee4186a0fe tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1673 microversion: 2.20 time: 0.153203 Aug 24 19:37:07.076426 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 571/1159] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:06 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:07.655255 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c6d5a51a-3a05-4c1c-98b8-10fe9964302f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:07.655821 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c6d5a51a-3a05-4c1c-98b8-10fe9964302f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:07.661572 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c6d5a51a-3a05-4c1c-98b8-10fe9964302f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:07.662018 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c6d5a51a-3a05-4c1c-98b8-10fe9964302f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:07.662774 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c6d5a51a-3a05-4c1c-98b8-10fe9964302f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:07.663205 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c6d5a51a-3a05-4c1c-98b8-10fe9964302f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:07.714781 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-00cb00ed-1663-4c48-bcd7-ab9709ae8a7a tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:07.715385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-00cb00ed-1663-4c48-bcd7-ab9709ae8a7a tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:07.721878 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-00cb00ed-1663-4c48-bcd7-ab9709ae8a7a tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:07.722394 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-00cb00ed-1663-4c48-bcd7-ab9709ae8a7a tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:07.723230 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-00cb00ed-1663-4c48-bcd7-ab9709ae8a7a tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:07.723894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-00cb00ed-1663-4c48-bcd7-ab9709ae8a7a tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:07.823455 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c6d5a51a-3a05-4c1c-98b8-10fe9964302f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:07.839548 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c6d5a51a-3a05-4c1c-98b8-10fe9964302f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.187887 Aug 24 19:37:07.839946 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 589/1160] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:07 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:07.874601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-00cb00ed-1663-4c48-bcd7-ab9709ae8a7a tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:07.882191 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-00cb00ed-1663-4c48-bcd7-ab9709ae8a7a tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1514 microversion: 2.1 time: 0.171139 Aug 24 19:37:07.882764 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 572/1161] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:07 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:37:08.094745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d080262c-0983-441d-ae6f-323fd9d04c9a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:08.095359 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d080262c-0983-441d-ae6f-323fd9d04c9a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:08.101461 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d080262c-0983-441d-ae6f-323fd9d04c9a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:08.101908 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d080262c-0983-441d-ae6f-323fd9d04c9a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:08.102680 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d080262c-0983-441d-ae6f-323fd9d04c9a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:08.103115 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d080262c-0983-441d-ae6f-323fd9d04c9a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:08.303741 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-d080262c-0983-441d-ae6f-323fd9d04c9a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:08.312774 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-d080262c-0983-441d-ae6f-323fd9d04c9a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:08.314366 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-d080262c-0983-441d-ae6f-323fd9d04c9a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:08.315526 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d080262c-0983-441d-ae6f-323fd9d04c9a tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1673 microversion: 2.20 time: 0.225159 Aug 24 19:37:08.316332 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 590/1162] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:08 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1673 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:08.684796 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-55531750-0fab-47fc-bec8-1e208cdb231f req-f983a51b-2d00-472b-9468-342505c0e70e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7337890-bb1a-4c01-8ed2-27b83a6f1591", "name": "network-vif-deleted", "tag": "5efe7ef9-e185-4bbf-baef-e51bd46803ca"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:37:08.686430 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:37:08.686430 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:37:08.694120 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-55531750-0fab-47fc-bec8-1e208cdb231f req-f983a51b-2d00-472b-9468-342505c0e70e service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:08.694576 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-55531750-0fab-47fc-bec8-1e208cdb231f req-f983a51b-2d00-472b-9468-342505c0e70e service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:08.706150 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-55531750-0fab-47fc-bec8-1e208cdb231f req-f983a51b-2d00-472b-9468-342505c0e70e service nova] Creating event network-vif-deleted:5efe7ef9-e185-4bbf-baef-e51bd46803ca for instance c7337890-bb1a-4c01-8ed2-27b83a6f1591 on hv-cinder-79819 Aug 24 19:37:08.710904 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-55531750-0fab-47fc-bec8-1e208cdb231f req-f983a51b-2d00-472b-9468-342505c0e70e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029837 Aug 24 19:37:08.713781 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 573/1163] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:37:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:37:08.855674 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c284b5ee-3e5f-486c-b6c8-d156acf7c1db tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:08.856297 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c284b5ee-3e5f-486c-b6c8-d156acf7c1db tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:08.862376 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c284b5ee-3e5f-486c-b6c8-d156acf7c1db tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:08.862603 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c284b5ee-3e5f-486c-b6c8-d156acf7c1db tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:08.863360 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c284b5ee-3e5f-486c-b6c8-d156acf7c1db tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:08.863805 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c284b5ee-3e5f-486c-b6c8-d156acf7c1db tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:08.900556 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-21ea7a07-8d99-4d38-aa70-812ec32497be tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:08.901252 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-21ea7a07-8d99-4d38-aa70-812ec32497be tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:08.907361 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-21ea7a07-8d99-4d38-aa70-812ec32497be tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:08.907812 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-21ea7a07-8d99-4d38-aa70-812ec32497be tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:08.908620 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-21ea7a07-8d99-4d38-aa70-812ec32497be tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:08.909226 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-21ea7a07-8d99-4d38-aa70-812ec32497be tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:08.990673 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-21ea7a07-8d99-4d38-aa70-812ec32497be tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:08.998605 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-21ea7a07-8d99-4d38-aa70-812ec32497be tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1303 microversion: 2.1 time: 0.102962 Aug 24 19:37:09.004685 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 574/1164] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:08 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:09.010693 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c284b5ee-3e5f-486c-b6c8-d156acf7c1db tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:09.018075 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c284b5ee-3e5f-486c-b6c8-d156acf7c1db tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.166113 Aug 24 19:37:09.018631 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 591/1165] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:08 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:09.334117 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b3510d4b-1e73-4b00-b22d-94e04ab037c0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:09.334817 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-b3510d4b-1e73-4b00-b22d-94e04ab037c0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:09.340693 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b3510d4b-1e73-4b00-b22d-94e04ab037c0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:09.341138 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b3510d4b-1e73-4b00-b22d-94e04ab037c0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:09.341978 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b3510d4b-1e73-4b00-b22d-94e04ab037c0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:09.342404 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-b3510d4b-1e73-4b00-b22d-94e04ab037c0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:09.357124 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5ee68e72-f81a-4c34-a385-70d083d7f774 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:09.357740 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5ee68e72-f81a-4c34-a385-70d083d7f774 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:09.364121 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5ee68e72-f81a-4c34-a385-70d083d7f774 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:09.364667 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5ee68e72-f81a-4c34-a385-70d083d7f774 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:09.365510 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5ee68e72-f81a-4c34-a385-70d083d7f774 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:09.366015 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5ee68e72-f81a-4c34-a385-70d083d7f774 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:09.379514 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-5ee68e72-f81a-4c34-a385-70d083d7f774 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] HTTP exception thrown: Instance f86c2b9c-45eb-40fe-a846-982db14d42cd could not be found. Aug 24 19:37:09.380212 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5ee68e72-f81a-4c34-a385-70d083d7f774 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Returning 404 to user: Instance f86c2b9c-45eb-40fe-a846-982db14d42cd could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:37:09.381154 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5ee68e72-f81a-4c34-a385-70d083d7f774 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 404 len: 111 microversion: 2.1 time: 0.027893 Aug 24 19:37:09.381917 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 592/1166] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:37:09 2021] DELETE /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 19:37:09.389426 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-516212b7-4c33-4892-81fd-2a1f2e08bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:09.390021 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-516212b7-4c33-4892-81fd-2a1f2e08bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: f86c2b9c-45eb-40fe-a846-982db14d42cd] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:09.396213 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-516212b7-4c33-4892-81fd-2a1f2e08bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:09.402183 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-516212b7-4c33-4892-81fd-2a1f2e08bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:09.402183 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-516212b7-4c33-4892-81fd-2a1f2e08bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:09.402183 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-516212b7-4c33-4892-81fd-2a1f2e08bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:09.412132 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-516212b7-4c33-4892-81fd-2a1f2e08bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] HTTP exception thrown: Instance f86c2b9c-45eb-40fe-a846-982db14d42cd could not be found. Aug 24 19:37:09.412751 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-516212b7-4c33-4892-81fd-2a1f2e08bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Returning 404 to user: Instance f86c2b9c-45eb-40fe-a846-982db14d42cd could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:37:09.413568 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-516212b7-4c33-4892-81fd-2a1f2e08bc68 tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd" status: 404 len: 111 microversion: 2.1 time: 0.027617 Aug 24 19:37:09.414107 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 593/1167] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:09 2021] GET /compute/v2.1/servers/f86c2b9c-45eb-40fe-a846-982db14d42cd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 19:37:09.506898 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b3510d4b-1e73-4b00-b22d-94e04ab037c0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:09.512549 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b3510d4b-1e73-4b00-b22d-94e04ab037c0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:09.514026 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-b3510d4b-1e73-4b00-b22d-94e04ab037c0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:09.515230 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b3510d4b-1e73-4b00-b22d-94e04ab037c0 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.184934 Aug 24 19:37:09.515798 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 575/1168] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:09 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:10.016822 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-13565902-9ce8-4dd0-8d4f-61a7530ea295 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:10.018020 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-13565902-9ce8-4dd0-8d4f-61a7530ea295 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:10.025540 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-13565902-9ce8-4dd0-8d4f-61a7530ea295 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:10.026669 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-13565902-9ce8-4dd0-8d4f-61a7530ea295 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:10.026894 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-13565902-9ce8-4dd0-8d4f-61a7530ea295 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:10.027320 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-13565902-9ce8-4dd0-8d4f-61a7530ea295 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:10.037001 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-7697f65a-7156-45bb-b4b2-2edebbc20c52 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:10.037611 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-7697f65a-7156-45bb-b4b2-2edebbc20c52 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:10.046451 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7697f65a-7156-45bb-b4b2-2edebbc20c52 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:10.047254 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7697f65a-7156-45bb-b4b2-2edebbc20c52 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:10.048033 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7697f65a-7156-45bb-b4b2-2edebbc20c52 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:10.048734 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7697f65a-7156-45bb-b4b2-2edebbc20c52 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:10.059765 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-13565902-9ce8-4dd0-8d4f-61a7530ea295 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:10.060341 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-13565902-9ce8-4dd0-8d4f-61a7530ea295 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:10.060812 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-13565902-9ce8-4dd0-8d4f-61a7530ea295 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lazy-loading 'fault' on Instance uuid c7337890-bb1a-4c01-8ed2-27b83a6f1591 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:37:10.110766 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-13565902-9ce8-4dd0-8d4f-61a7530ea295 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2dcc1b5cebb47ba8ed7283904b5775a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '557992a6150e4dffb7039761938b1ee5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:10.118232 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-13565902-9ce8-4dd0-8d4f-61a7530ea295 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 200 len: 1308 microversion: 2.1 time: 0.105978 Aug 24 19:37:10.119229 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 594/1169] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:10 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 1308 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:10.191826 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-7697f65a-7156-45bb-b4b2-2edebbc20c52 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:10.199205 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-7697f65a-7156-45bb-b4b2-2edebbc20c52 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.167464 Aug 24 19:37:10.199772 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 576/1170] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:10 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:10.533340 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-cf2e448f-e66e-43a0-a8a9-69c6edf5587f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:10.533944 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-cf2e448f-e66e-43a0-a8a9-69c6edf5587f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:10.540291 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cf2e448f-e66e-43a0-a8a9-69c6edf5587f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:10.540789 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cf2e448f-e66e-43a0-a8a9-69c6edf5587f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:10.541551 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cf2e448f-e66e-43a0-a8a9-69c6edf5587f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:10.542161 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cf2e448f-e66e-43a0-a8a9-69c6edf5587f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:10.709672 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-cf2e448f-e66e-43a0-a8a9-69c6edf5587f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:10.719223 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-cf2e448f-e66e-43a0-a8a9-69c6edf5587f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:10.721996 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-cf2e448f-e66e-43a0-a8a9-69c6edf5587f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:10.724304 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-cf2e448f-e66e-43a0-a8a9-69c6edf5587f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.193665 Aug 24 19:37:10.724304 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 595/1171] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:10 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:10.803829 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e529661a-93b3-4b52-ac5b-d9ffb984671f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:10.804463 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e529661a-93b3-4b52-ac5b-d9ffb984671f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:10.811525 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e529661a-93b3-4b52-ac5b-d9ffb984671f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:10.811964 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e529661a-93b3-4b52-ac5b-d9ffb984671f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:10.813338 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e529661a-93b3-4b52-ac5b-d9ffb984671f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:10.813950 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e529661a-93b3-4b52-ac5b-d9ffb984671f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:10.833751 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-e529661a-93b3-4b52-ac5b-d9ffb984671f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] HTTP exception thrown: Instance a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 could not be found. Aug 24 19:37:10.834938 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e529661a-93b3-4b52-ac5b-d9ffb984671f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Returning 404 to user: Instance a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:37:10.836130 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e529661a-93b3-4b52-ac5b-d9ffb984671f tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 404 len: 111 microversion: 2.1 time: 0.036024 Aug 24 19:37:10.837338 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 577/1172] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:37:10 2021] DELETE /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 19:37:10.846060 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1b13bae2-e31b-4c09-87ad-1e0e446c01cf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:10.846673 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1b13bae2-e31b-4c09-87ad-1e0e446c01cf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] [instance: a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:10.852969 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1b13bae2-e31b-4c09-87ad-1e0e446c01cf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:10.853514 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1b13bae2-e31b-4c09-87ad-1e0e446c01cf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:10.854327 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1b13bae2-e31b-4c09-87ad-1e0e446c01cf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:10.854807 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1b13bae2-e31b-4c09-87ad-1e0e446c01cf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:10.869777 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-1b13bae2-e31b-4c09-87ad-1e0e446c01cf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] HTTP exception thrown: Instance a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 could not be found. Aug 24 19:37:10.870404 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1b13bae2-e31b-4c09-87ad-1e0e446c01cf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] Returning 404 to user: Instance a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:37:10.871236 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1b13bae2-e31b-4c09-87ad-1e0e446c01cf tempest-AttachVolumeTestJSON-1275232558 tempest-AttachVolumeTestJSON-1275232558-project] 10.222.0.59 "GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01" status: 404 len: 111 microversion: 2.1 time: 0.029940 Aug 24 19:37:10.871867 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 596/1173] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:10 2021] GET /compute/v2.1/servers/a1e7c3d1-78c0-466e-8c2f-568e7ebbcc01 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:37:11.136739 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-05ad7dfa-3735-4c9e-8144-87bd8d4d02a0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:11.137304 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-05ad7dfa-3735-4c9e-8144-87bd8d4d02a0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] [instance: c7337890-bb1a-4c01-8ed2-27b83a6f1591] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:11.144350 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05ad7dfa-3735-4c9e-8144-87bd8d4d02a0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:11.144795 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05ad7dfa-3735-4c9e-8144-87bd8d4d02a0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:11.145580 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05ad7dfa-3735-4c9e-8144-87bd8d4d02a0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:11.146065 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05ad7dfa-3735-4c9e-8144-87bd8d4d02a0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:11.161455 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-05ad7dfa-3735-4c9e-8144-87bd8d4d02a0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] HTTP exception thrown: Instance c7337890-bb1a-4c01-8ed2-27b83a6f1591 could not be found. Aug 24 19:37:11.162054 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-05ad7dfa-3735-4c9e-8144-87bd8d4d02a0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] Returning 404 to user: Instance c7337890-bb1a-4c01-8ed2-27b83a6f1591 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:37:11.163000 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-05ad7dfa-3735-4c9e-8144-87bd8d4d02a0 tempest-VolumesSnapshotTestJSON-23961263 tempest-VolumesSnapshotTestJSON-23961263-project] 10.222.0.59 "GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591" status: 404 len: 111 microversion: 2.1 time: 0.030455 Aug 24 19:37:11.164165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 578/1174] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:11 2021] GET /compute/v2.1/servers/c7337890-bb1a-4c01-8ed2-27b83a6f1591 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:37:11.217575 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-23b45b93-d70a-47f3-9dbd-fdffa5ce7510 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:11.219961 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-23b45b93-d70a-47f3-9dbd-fdffa5ce7510 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:11.227291 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-23b45b93-d70a-47f3-9dbd-fdffa5ce7510 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:11.228119 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-23b45b93-d70a-47f3-9dbd-fdffa5ce7510 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:11.229697 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-23b45b93-d70a-47f3-9dbd-fdffa5ce7510 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:11.230387 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-23b45b93-d70a-47f3-9dbd-fdffa5ce7510 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:11.392985 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-23b45b93-d70a-47f3-9dbd-fdffa5ce7510 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:11.401057 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-23b45b93-d70a-47f3-9dbd-fdffa5ce7510 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.187905 Aug 24 19:37:11.404321 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 597/1175] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:11 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:11.750509 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-dac2c071-e1c4-44df-82ce-4ccb18a65779 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:11.750509 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-dac2c071-e1c4-44df-82ce-4ccb18a65779 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:11.750509 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dac2c071-e1c4-44df-82ce-4ccb18a65779 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:11.750509 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dac2c071-e1c4-44df-82ce-4ccb18a65779 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:11.750896 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dac2c071-e1c4-44df-82ce-4ccb18a65779 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:11.750896 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dac2c071-e1c4-44df-82ce-4ccb18a65779 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:11.918953 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-dac2c071-e1c4-44df-82ce-4ccb18a65779 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:11.939378 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-dac2c071-e1c4-44df-82ce-4ccb18a65779 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:11.945936 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-dac2c071-e1c4-44df-82ce-4ccb18a65779 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:11.947257 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-dac2c071-e1c4-44df-82ce-4ccb18a65779 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.209472 Aug 24 19:37:11.955025 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 579/1176] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:11 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:12.083934 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-b12944a3-84f1-40ce-ac72-971caace4bd8 req-4865f8ee-da66-49ad-8daa-1c077d288a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff70d818-92c2-45bf-b298-96a45eb576a3", "name": "network-vif-plugged", "status": "completed", "tag": "9eae3e9d-b91a-4a71-8862-9ab8e3b42579"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:37:12.086541 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:37:12.086541 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:37:12.096422 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-b12944a3-84f1-40ce-ac72-971caace4bd8 req-4865f8ee-da66-49ad-8daa-1c077d288a6d service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:12.098240 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-b12944a3-84f1-40ce-ac72-971caace4bd8 req-4865f8ee-da66-49ad-8daa-1c077d288a6d service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:12.110659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-b12944a3-84f1-40ce-ac72-971caace4bd8 req-4865f8ee-da66-49ad-8daa-1c077d288a6d service nova] Creating event network-vif-plugged:9eae3e9d-b91a-4a71-8862-9ab8e3b42579 for instance ff70d818-92c2-45bf-b298-96a45eb576a3 on hv-cinder-79819 Aug 24 19:37:12.116174 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-b12944a3-84f1-40ce-ac72-971caace4bd8 req-4865f8ee-da66-49ad-8daa-1c077d288a6d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043471 Aug 24 19:37:12.117277 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 598/1177] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:37:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:37:12.419015 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-0c11a05a-0e2f-4dc7-b56a-77572c087d09 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:12.419614 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-0c11a05a-0e2f-4dc7-b56a-77572c087d09 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:12.426979 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0c11a05a-0e2f-4dc7-b56a-77572c087d09 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:12.427686 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0c11a05a-0e2f-4dc7-b56a-77572c087d09 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:12.428641 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0c11a05a-0e2f-4dc7-b56a-77572c087d09 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:12.429225 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-0c11a05a-0e2f-4dc7-b56a-77572c087d09 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:12.584446 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-0c11a05a-0e2f-4dc7-b56a-77572c087d09 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:12.592661 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-0c11a05a-0e2f-4dc7-b56a-77572c087d09 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.177110 Aug 24 19:37:12.593943 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 580/1178] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:12 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:12.974135 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-3d435a92-2a0b-4b66-8a52-3f966472e7a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:12.975545 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3d435a92-2a0b-4b66-8a52-3f966472e7a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:12.984712 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3d435a92-2a0b-4b66-8a52-3f966472e7a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:12.985162 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3d435a92-2a0b-4b66-8a52-3f966472e7a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:12.986124 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3d435a92-2a0b-4b66-8a52-3f966472e7a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:12.986722 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3d435a92-2a0b-4b66-8a52-3f966472e7a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:13.142131 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3d435a92-2a0b-4b66-8a52-3f966472e7a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:13.159281 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3d435a92-2a0b-4b66-8a52-3f966472e7a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:13.161374 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3d435a92-2a0b-4b66-8a52-3f966472e7a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:13.164405 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-3d435a92-2a0b-4b66-8a52-3f966472e7a8 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.193014 Aug 24 19:37:13.175039 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 599/1179] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:12 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:13.611042 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-190c94aa-bc42-4285-bd53-3c6ff4984423 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:13.612610 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-190c94aa-bc42-4285-bd53-3c6ff4984423 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:13.626871 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-190c94aa-bc42-4285-bd53-3c6ff4984423 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:13.633542 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-190c94aa-bc42-4285-bd53-3c6ff4984423 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:13.635243 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-190c94aa-bc42-4285-bd53-3c6ff4984423 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:13.638354 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-190c94aa-bc42-4285-bd53-3c6ff4984423 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:13.834314 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-190c94aa-bc42-4285-bd53-3c6ff4984423 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:13.842003 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-190c94aa-bc42-4285-bd53-3c6ff4984423 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.235242 Aug 24 19:37:13.842704 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 581/1180] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:13 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:14.186427 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-12f74ac4-ee1c-4565-ad4b-6a8c323afc58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:14.186427 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-12f74ac4-ee1c-4565-ad4b-6a8c323afc58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:14.190064 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-12f74ac4-ee1c-4565-ad4b-6a8c323afc58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:14.190438 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-12f74ac4-ee1c-4565-ad4b-6a8c323afc58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:14.191235 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-12f74ac4-ee1c-4565-ad4b-6a8c323afc58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:14.191674 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-12f74ac4-ee1c-4565-ad4b-6a8c323afc58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:14.333400 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-12f74ac4-ee1c-4565-ad4b-6a8c323afc58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:14.341519 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-12f74ac4-ee1c-4565-ad4b-6a8c323afc58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:14.343015 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-12f74ac4-ee1c-4565-ad4b-6a8c323afc58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:14.344224 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-12f74ac4-ee1c-4565-ad4b-6a8c323afc58 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.165461 Aug 24 19:37:14.355020 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 600/1181] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:14 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:14.868182 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-02aa64c4-c003-48d1-bf8d-c448db629fc3 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:14.868813 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-02aa64c4-c003-48d1-bf8d-c448db629fc3 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:14.880348 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-02aa64c4-c003-48d1-bf8d-c448db629fc3 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:14.880982 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-02aa64c4-c003-48d1-bf8d-c448db629fc3 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:14.883096 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-02aa64c4-c003-48d1-bf8d-c448db629fc3 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:14.883949 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-02aa64c4-c003-48d1-bf8d-c448db629fc3 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:15.118850 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-02aa64c4-c003-48d1-bf8d-c448db629fc3 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:15.132606 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-02aa64c4-c003-48d1-bf8d-c448db629fc3 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.277082 Aug 24 19:37:15.133530 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 582/1182] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:14 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:15.361815 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e5dd932c-4963-4ae1-accc-c833ba639c0f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:15.363048 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e5dd932c-4963-4ae1-accc-c833ba639c0f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:15.369523 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5dd932c-4963-4ae1-accc-c833ba639c0f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:15.370263 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5dd932c-4963-4ae1-accc-c833ba639c0f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:15.371246 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5dd932c-4963-4ae1-accc-c833ba639c0f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:15.372142 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5dd932c-4963-4ae1-accc-c833ba639c0f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:15.555938 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e5dd932c-4963-4ae1-accc-c833ba639c0f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:15.566386 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e5dd932c-4963-4ae1-accc-c833ba639c0f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:15.568691 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e5dd932c-4963-4ae1-accc-c833ba639c0f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:15.570285 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e5dd932c-4963-4ae1-accc-c833ba639c0f tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.212849 Aug 24 19:37:15.579190 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 601/1183] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:15 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:16.150260 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-af1bc9fe-3607-4001-9d35-f6256685886e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:16.150901 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-af1bc9fe-3607-4001-9d35-f6256685886e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:16.157358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-af1bc9fe-3607-4001-9d35-f6256685886e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:16.157806 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-af1bc9fe-3607-4001-9d35-f6256685886e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:16.158654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-af1bc9fe-3607-4001-9d35-f6256685886e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:16.159057 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-af1bc9fe-3607-4001-9d35-f6256685886e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:16.302887 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-af1bc9fe-3607-4001-9d35-f6256685886e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:16.310578 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-af1bc9fe-3607-4001-9d35-f6256685886e tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.163943 Aug 24 19:37:16.315805 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 583/1184] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:16 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:16.597928 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-bffc0b42-2748-4403-85ad-116f3130e070 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:16.598666 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-bffc0b42-2748-4403-85ad-116f3130e070 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:16.605231 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bffc0b42-2748-4403-85ad-116f3130e070 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:16.605756 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bffc0b42-2748-4403-85ad-116f3130e070 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:16.607405 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bffc0b42-2748-4403-85ad-116f3130e070 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:16.608012 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bffc0b42-2748-4403-85ad-116f3130e070 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:16.738879 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-bffc0b42-2748-4403-85ad-116f3130e070 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:16.747101 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-bffc0b42-2748-4403-85ad-116f3130e070 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:16.748518 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-bffc0b42-2748-4403-85ad-116f3130e070 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:16.749719 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-bffc0b42-2748-4403-85ad-116f3130e070 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.155591 Aug 24 19:37:16.750270 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 602/1185] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:16 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:17.326871 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-54a53394-9821-4c0d-9f2d-b17bb46512e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:17.327990 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-54a53394-9821-4c0d-9f2d-b17bb46512e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:17.334104 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-54a53394-9821-4c0d-9f2d-b17bb46512e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:17.334550 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-54a53394-9821-4c0d-9f2d-b17bb46512e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:17.335349 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-54a53394-9821-4c0d-9f2d-b17bb46512e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:17.335780 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-54a53394-9821-4c0d-9f2d-b17bb46512e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:17.507053 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-54a53394-9821-4c0d-9f2d-b17bb46512e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:17.515921 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-54a53394-9821-4c0d-9f2d-b17bb46512e1 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.192607 Aug 24 19:37:17.516984 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 584/1186] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:17 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:37:17.770006 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1a72e88f-2e3a-4808-b577-53d9bc081bde tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:17.774364 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1a72e88f-2e3a-4808-b577-53d9bc081bde tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:17.780571 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1a72e88f-2e3a-4808-b577-53d9bc081bde tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:17.781154 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1a72e88f-2e3a-4808-b577-53d9bc081bde tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:17.781940 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1a72e88f-2e3a-4808-b577-53d9bc081bde tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:17.782402 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1a72e88f-2e3a-4808-b577-53d9bc081bde tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:17.915002 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1a72e88f-2e3a-4808-b577-53d9bc081bde tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:17.924761 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1a72e88f-2e3a-4808-b577-53d9bc081bde tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:17.926239 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1a72e88f-2e3a-4808-b577-53d9bc081bde tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:17.927382 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1a72e88f-2e3a-4808-b577-53d9bc081bde tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.164059 Aug 24 19:37:17.927967 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 603/1187] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:17 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:18.271607 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4d2a3aa8-554f-45db-b56e-692b7eeb61bb tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] Action: 'create', calling method: .version_select at 0x7f8df7254f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1962529653", "metadata": {"Type": "work"}}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:37:18.271607 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-4d2a3aa8-554f-45db-b56e-692b7eeb61bb tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:37:18.271607 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-4d2a3aa8-554f-45db-b56e-692b7eeb61bb tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.139154 Aug 24 19:37:18.272482 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 585/1188] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Aug 24 19:37:18 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 19:37:18.282243 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9fe00ec6-5b27-4e9a-9961-a3547375b5f8 tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] Action: 'create', calling method: .version_select at 0x7f8df73b49d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1858225515", "metadata": {"Type": "work"}}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:37:18.283988 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9fe00ec6-5b27-4e9a-9961-a3547375b5f8 tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:37:18.284817 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9fe00ec6-5b27-4e9a-9961-a3547375b5f8 tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007061 Aug 24 19:37:18.285353 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 604/1189] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Aug 24 19:37:18 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 19:37:18.294755 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b9933a99-10c6-4ca4-8fd6-af6d9cf09e0e tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] Action: 'create', calling method: .version_select at 0x7f8df7272af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1773926593", "metadata": {"Type": "work"}}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:37:18.296184 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-b9933a99-10c6-4ca4-8fd6-af6d9cf09e0e tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:37:18.297521 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-b9933a99-10c6-4ca4-8fd6-af6d9cf09e0e tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006576 Aug 24 19:37:18.298244 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 586/1190] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Aug 24 19:37:18 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 19:37:18.308232 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d2a54835-8de1-4490-95a2-303b49ee30a3 tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] Calling method '.version_select at 0x7f8df73a00d0>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:18.346890 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-d2a54835-8de1-4490-95a2-303b49ee30a3 tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] HTTP exception thrown: Volume tempest-invalid-188548259 could not be found. Aug 24 19:37:18.346890 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d2a54835-8de1-4490-95a2-303b49ee30a3 tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] Returning 404 to user: Volume tempest-invalid-188548259 could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:37:18.346890 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d2a54835-8de1-4490-95a2-303b49ee30a3 tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-188548259" status: 404 len: 98 microversion: 2.1 time: 0.041081 Aug 24 19:37:18.346890 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 605/1191] 10.222.0.59 () {58 vars in 1215 bytes} [Tue Aug 24 19:37:18 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-188548259 => generated 98 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 19:37:18.356744 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9a17c030-dbb9-46cc-bd1e-cd1d41023ac1 tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004641 Aug 24 19:37:18.357521 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 587/1192] 10.222.0.59 () {58 vars in 1140 bytes} [Tue Aug 24 19:37:18 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 19:37:18.366099 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-81338616-d95e-4bcc-bcd8-cf9a9f9068c3 tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003628 Aug 24 19:37:18.373154 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 606/1193] 10.222.0.59 () {58 vars in 1137 bytes} [Tue Aug 24 19:37:18 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 19:37:18.383954 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-09f315e9-321a-4ecd-b6dd-4c95642fda94 tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] Calling method '.version_select at 0x7f8df72725e0>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:18.412870 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-09f315e9-321a-4ecd-b6dd-4c95642fda94 tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] HTTP exception thrown: Volume 9506a00a-3b02-4721-8637-b4eb827c8a37 could not be found. Aug 24 19:37:18.412870 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-09f315e9-321a-4ecd-b6dd-4c95642fda94 tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] Returning 404 to user: Volume 9506a00a-3b02-4721-8637-b4eb827c8a37 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:37:18.412870 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-09f315e9-321a-4ecd-b6dd-4c95642fda94 tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/9506a00a-3b02-4721-8637-b4eb827c8a37" status: 404 len: 109 microversion: 2.1 time: 0.039920 Aug 24 19:37:18.412870 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 588/1194] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Aug 24 19:37:18 2021] DELETE /compute/v2.1/os-volumes/9506a00a-3b02-4721-8637-b4eb827c8a37 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:37:18.423185 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7db1f637-ea65-4b36-a9d8-97477348583e tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] Calling method '.version_select at 0x7f8df7348700>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:18.465368 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-7db1f637-ea65-4b36-a9d8-97477348583e tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] HTTP exception thrown: Volume cd61351c-b17b-4271-bfa0-7ab402391c3e could not be found. Aug 24 19:37:18.465917 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7db1f637-ea65-4b36-a9d8-97477348583e tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] Returning 404 to user: Volume cd61351c-b17b-4271-bfa0-7ab402391c3e could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:37:18.466741 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7db1f637-ea65-4b36-a9d8-97477348583e tempest-VolumesNegativeTest-1183539363 tempest-VolumesNegativeTest-1183539363-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/cd61351c-b17b-4271-bfa0-7ab402391c3e" status: 404 len: 109 microversion: 2.1 time: 0.049049 Aug 24 19:37:18.467279 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 607/1195] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Aug 24 19:37:18 2021] GET /compute/v2.1/os-volumes/cd61351c-b17b-4271-bfa0-7ab402391c3e => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:37:18.535984 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-746622d8-c5c7-48ad-84c3-dcbfdfb1a8bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:18.537039 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-746622d8-c5c7-48ad-84c3-dcbfdfb1a8bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:18.546276 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-746622d8-c5c7-48ad-84c3-dcbfdfb1a8bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:18.552858 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-746622d8-c5c7-48ad-84c3-dcbfdfb1a8bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:18.552858 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-746622d8-c5c7-48ad-84c3-dcbfdfb1a8bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:18.552858 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-746622d8-c5c7-48ad-84c3-dcbfdfb1a8bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:18.709145 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-746622d8-c5c7-48ad-84c3-dcbfdfb1a8bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:18.716621 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-746622d8-c5c7-48ad-84c3-dcbfdfb1a8bb tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.186642 Aug 24 19:37:18.717182 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 589/1196] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:18 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:18.945956 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-bc58898b-540f-4440-84b4-bc93cdf60254 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:18.946557 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-bc58898b-540f-4440-84b4-bc93cdf60254 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:18.953383 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bc58898b-540f-4440-84b4-bc93cdf60254 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:18.953820 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bc58898b-540f-4440-84b4-bc93cdf60254 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:18.954573 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bc58898b-540f-4440-84b4-bc93cdf60254 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:18.954994 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bc58898b-540f-4440-84b4-bc93cdf60254 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:19.100366 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-bc58898b-540f-4440-84b4-bc93cdf60254 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:19.109644 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-bc58898b-540f-4440-84b4-bc93cdf60254 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:19.111120 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-bc58898b-540f-4440-84b4-bc93cdf60254 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:19.112253 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-bc58898b-540f-4440-84b4-bc93cdf60254 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.170443 Aug 24 19:37:19.112879 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 608/1197] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:18 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:19.734705 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8cdc566f-9862-4436-ad1c-63a4109862b5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:19.735394 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8cdc566f-9862-4436-ad1c-63a4109862b5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:19.741274 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8cdc566f-9862-4436-ad1c-63a4109862b5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:19.741718 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8cdc566f-9862-4436-ad1c-63a4109862b5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:19.742478 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8cdc566f-9862-4436-ad1c-63a4109862b5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:19.742901 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8cdc566f-9862-4436-ad1c-63a4109862b5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:20.042864 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8cdc566f-9862-4436-ad1c-63a4109862b5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:20.051167 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8cdc566f-9862-4436-ad1c-63a4109862b5 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.320534 Aug 24 19:37:20.051730 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 590/1198] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:19 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:20.131158 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b1c82ddc-94b7-41c6-af0e-f645cd8986f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:20.131775 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b1c82ddc-94b7-41c6-af0e-f645cd8986f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:20.140738 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b1c82ddc-94b7-41c6-af0e-f645cd8986f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:20.140738 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b1c82ddc-94b7-41c6-af0e-f645cd8986f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:20.140738 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b1c82ddc-94b7-41c6-af0e-f645cd8986f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:20.140738 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b1c82ddc-94b7-41c6-af0e-f645cd8986f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:20.313803 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b1c82ddc-94b7-41c6-af0e-f645cd8986f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:20.325747 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b1c82ddc-94b7-41c6-af0e-f645cd8986f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:20.328964 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b1c82ddc-94b7-41c6-af0e-f645cd8986f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:20.330540 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b1c82ddc-94b7-41c6-af0e-f645cd8986f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.203352 Aug 24 19:37:20.331827 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 609/1199] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:20 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:21.068691 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-1cf141e6-40cc-4f6b-9149-fe96df582907 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:21.069472 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-1cf141e6-40cc-4f6b-9149-fe96df582907 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:21.075898 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1cf141e6-40cc-4f6b-9149-fe96df582907 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:21.076459 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1cf141e6-40cc-4f6b-9149-fe96df582907 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:21.077299 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1cf141e6-40cc-4f6b-9149-fe96df582907 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:21.077804 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-1cf141e6-40cc-4f6b-9149-fe96df582907 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:21.201881 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-1cf141e6-40cc-4f6b-9149-fe96df582907 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:21.212565 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-1cf141e6-40cc-4f6b-9149-fe96df582907 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.144880 Aug 24 19:37:21.212565 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 591/1200] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:21 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:21.349189 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-831ba09e-f947-4278-9dd6-7154cc6b167c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:21.349794 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-831ba09e-f947-4278-9dd6-7154cc6b167c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:21.355678 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-831ba09e-f947-4278-9dd6-7154cc6b167c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:21.356117 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-831ba09e-f947-4278-9dd6-7154cc6b167c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:21.356959 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-831ba09e-f947-4278-9dd6-7154cc6b167c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:21.357384 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-831ba09e-f947-4278-9dd6-7154cc6b167c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:21.565953 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-831ba09e-f947-4278-9dd6-7154cc6b167c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:21.575902 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-831ba09e-f947-4278-9dd6-7154cc6b167c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:21.578264 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-831ba09e-f947-4278-9dd6-7154cc6b167c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:21.580098 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-831ba09e-f947-4278-9dd6-7154cc6b167c tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.234489 Aug 24 19:37:21.580879 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 610/1201] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:21 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:22.226596 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-09e16fa7-3d42-4be8-8d18-743c58157093 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:22.227233 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-09e16fa7-3d42-4be8-8d18-743c58157093 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:22.233191 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-09e16fa7-3d42-4be8-8d18-743c58157093 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:22.233633 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-09e16fa7-3d42-4be8-8d18-743c58157093 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:22.234394 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-09e16fa7-3d42-4be8-8d18-743c58157093 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:22.234817 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-09e16fa7-3d42-4be8-8d18-743c58157093 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:22.364308 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-09e16fa7-3d42-4be8-8d18-743c58157093 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:22.372519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-09e16fa7-3d42-4be8-8d18-743c58157093 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1574 microversion: 2.1 time: 0.149480 Aug 24 19:37:22.373974 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 592/1202] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:22 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:22.598096 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-9cf9cdb9-a4f1-4b68-b95e-4dbc8ca531ec tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:22.598691 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-9cf9cdb9-a4f1-4b68-b95e-4dbc8ca531ec tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:22.604969 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdb9-a4f1-4b68-b95e-4dbc8ca531ec tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:22.605410 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdb9-a4f1-4b68-b95e-4dbc8ca531ec tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:22.606252 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdb9-a4f1-4b68-b95e-4dbc8ca531ec tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:22.606676 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-9cf9cdb9-a4f1-4b68-b95e-4dbc8ca531ec tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:22.736002 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9cf9cdb9-a4f1-4b68-b95e-4dbc8ca531ec tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:22.744229 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9cf9cdb9-a4f1-4b68-b95e-4dbc8ca531ec tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:22.745846 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-9cf9cdb9-a4f1-4b68-b95e-4dbc8ca531ec tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:22.747131 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-9cf9cdb9-a4f1-4b68-b95e-4dbc8ca531ec tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.152689 Aug 24 19:37:22.752615 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 611/1203] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:22 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:23.390028 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f8d55fe7-1a39-496d-8f45-ba820be16330 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:23.390634 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f8d55fe7-1a39-496d-8f45-ba820be16330 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:23.396725 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f8d55fe7-1a39-496d-8f45-ba820be16330 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:23.397168 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f8d55fe7-1a39-496d-8f45-ba820be16330 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:23.397928 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f8d55fe7-1a39-496d-8f45-ba820be16330 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:23.398358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f8d55fe7-1a39-496d-8f45-ba820be16330 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:23.516376 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f8d55fe7-1a39-496d-8f45-ba820be16330 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:23.523967 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f8d55fe7-1a39-496d-8f45-ba820be16330 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1561 microversion: 2.1 time: 0.138090 Aug 24 19:37:23.524563 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 593/1204] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:37:23 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1561 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:37:23.766674 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f97dfb21-eae6-48a2-bb61-7f3a2ac190e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:23.767345 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f97dfb21-eae6-48a2-bb61-7f3a2ac190e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:23.773377 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f97dfb21-eae6-48a2-bb61-7f3a2ac190e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:23.773818 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f97dfb21-eae6-48a2-bb61-7f3a2ac190e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:23.776287 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f97dfb21-eae6-48a2-bb61-7f3a2ac190e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:23.776287 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f97dfb21-eae6-48a2-bb61-7f3a2ac190e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:23.900539 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f97dfb21-eae6-48a2-bb61-7f3a2ac190e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:23.909837 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f97dfb21-eae6-48a2-bb61-7f3a2ac190e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:23.911402 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f97dfb21-eae6-48a2-bb61-7f3a2ac190e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:23.912604 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f97dfb21-eae6-48a2-bb61-7f3a2ac190e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.150303 Aug 24 19:37:23.917933 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 612/1205] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:23 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:24.934638 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-494e1d04-773a-4343-8341-8386c07155da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:24.935241 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-494e1d04-773a-4343-8341-8386c07155da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:24.941734 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-494e1d04-773a-4343-8341-8386c07155da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:24.942183 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-494e1d04-773a-4343-8341-8386c07155da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:24.942951 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-494e1d04-773a-4343-8341-8386c07155da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:24.943380 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-494e1d04-773a-4343-8341-8386c07155da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:25.077932 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-494e1d04-773a-4343-8341-8386c07155da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:25.085984 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-494e1d04-773a-4343-8341-8386c07155da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:25.087548 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-494e1d04-773a-4343-8341-8386c07155da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:25.088741 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-494e1d04-773a-4343-8341-8386c07155da tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.158061 Aug 24 19:37:25.092744 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 594/1206] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:24 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:26.107531 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-3ab0e73a-64c8-4d31-9df0-6b53617e9f21 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:26.108131 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3ab0e73a-64c8-4d31-9df0-6b53617e9f21 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:26.114119 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3ab0e73a-64c8-4d31-9df0-6b53617e9f21 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:26.114623 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3ab0e73a-64c8-4d31-9df0-6b53617e9f21 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:26.115336 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3ab0e73a-64c8-4d31-9df0-6b53617e9f21 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:26.115769 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3ab0e73a-64c8-4d31-9df0-6b53617e9f21 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:26.241271 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3ab0e73a-64c8-4d31-9df0-6b53617e9f21 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:26.252765 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3ab0e73a-64c8-4d31-9df0-6b53617e9f21 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:26.254679 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-3ab0e73a-64c8-4d31-9df0-6b53617e9f21 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:26.256282 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-3ab0e73a-64c8-4d31-9df0-6b53617e9f21 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.152315 Aug 24 19:37:26.257047 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 613/1207] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:26 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:27.274733 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d2136949-0e97-4893-bde7-2d75122a11b1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:27.275374 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d2136949-0e97-4893-bde7-2d75122a11b1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:27.281636 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d2136949-0e97-4893-bde7-2d75122a11b1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:27.282108 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d2136949-0e97-4893-bde7-2d75122a11b1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:27.282859 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d2136949-0e97-4893-bde7-2d75122a11b1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:27.283287 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d2136949-0e97-4893-bde7-2d75122a11b1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:27.415214 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d2136949-0e97-4893-bde7-2d75122a11b1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:27.424115 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d2136949-0e97-4893-bde7-2d75122a11b1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:27.425537 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d2136949-0e97-4893-bde7-2d75122a11b1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:27.426681 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d2136949-0e97-4893-bde7-2d75122a11b1 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.155749 Aug 24 19:37:27.427235 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 595/1208] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:27 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:28.444481 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-207d24cf-ac9a-4414-8f4c-bb56cd865b7d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:28.445083 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-207d24cf-ac9a-4414-8f4c-bb56cd865b7d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:28.451164 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-207d24cf-ac9a-4414-8f4c-bb56cd865b7d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:28.451612 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-207d24cf-ac9a-4414-8f4c-bb56cd865b7d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:28.452888 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-207d24cf-ac9a-4414-8f4c-bb56cd865b7d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:28.453319 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-207d24cf-ac9a-4414-8f4c-bb56cd865b7d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:28.574861 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-207d24cf-ac9a-4414-8f4c-bb56cd865b7d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:28.583201 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-207d24cf-ac9a-4414-8f4c-bb56cd865b7d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:28.584726 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-207d24cf-ac9a-4414-8f4c-bb56cd865b7d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:28.585915 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-207d24cf-ac9a-4414-8f4c-bb56cd865b7d tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.145050 Aug 24 19:37:28.586479 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 614/1209] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:28 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:28.902088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-5a7dfdc4-7ab4-48d0-a6eb-bb9553601795 req-dca0e4ab-0275-4917-8ea1-7096e671e507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7c8a14-baa7-4787-b6dd-21860c419bda", "name": "network-vif-plugged", "status": "completed", "tag": "bdbbbe75-74f7-4905-ad5d-1fc34d1d189b"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:37:28.904075 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:37:28.904075 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:37:28.911180 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-5a7dfdc4-7ab4-48d0-a6eb-bb9553601795 req-dca0e4ab-0275-4917-8ea1-7096e671e507 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:28.911857 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-5a7dfdc4-7ab4-48d0-a6eb-bb9553601795 req-dca0e4ab-0275-4917-8ea1-7096e671e507 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:28.924095 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-5a7dfdc4-7ab4-48d0-a6eb-bb9553601795 req-dca0e4ab-0275-4917-8ea1-7096e671e507 service nova] Creating event network-vif-plugged:bdbbbe75-74f7-4905-ad5d-1fc34d1d189b for instance df7c8a14-baa7-4787-b6dd-21860c419bda on hv-cinder-79819 Aug 24 19:37:28.929202 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-5a7dfdc4-7ab4-48d0-a6eb-bb9553601795 req-dca0e4ab-0275-4917-8ea1-7096e671e507 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031001 Aug 24 19:37:28.929789 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 596/1210] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:37:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:37:29.604418 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ec58522f-bb22-4981-acf9-2f89d8316d6e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:29.605021 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ec58522f-bb22-4981-acf9-2f89d8316d6e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:29.611001 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ec58522f-bb22-4981-acf9-2f89d8316d6e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:29.611449 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ec58522f-bb22-4981-acf9-2f89d8316d6e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:29.612211 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ec58522f-bb22-4981-acf9-2f89d8316d6e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:29.612671 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ec58522f-bb22-4981-acf9-2f89d8316d6e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:29.743729 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ec58522f-bb22-4981-acf9-2f89d8316d6e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:29.752193 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ec58522f-bb22-4981-acf9-2f89d8316d6e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:29.753863 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ec58522f-bb22-4981-acf9-2f89d8316d6e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:29.754986 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ec58522f-bb22-4981-acf9-2f89d8316d6e tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.154420 Aug 24 19:37:29.755551 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 615/1211] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:29 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:30.775063 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-27c20e9d-38c1-46de-a0ab-b0a86f70fb03 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:30.775819 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-27c20e9d-38c1-46de-a0ab-b0a86f70fb03 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:30.782568 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-27c20e9d-38c1-46de-a0ab-b0a86f70fb03 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:30.783718 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-27c20e9d-38c1-46de-a0ab-b0a86f70fb03 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:30.785020 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-27c20e9d-38c1-46de-a0ab-b0a86f70fb03 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:30.785616 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-27c20e9d-38c1-46de-a0ab-b0a86f70fb03 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:30.942959 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-27c20e9d-38c1-46de-a0ab-b0a86f70fb03 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:30.950825 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-27c20e9d-38c1-46de-a0ab-b0a86f70fb03 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:30.952834 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-27c20e9d-38c1-46de-a0ab-b0a86f70fb03 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:30.953971 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-27c20e9d-38c1-46de-a0ab-b0a86f70fb03 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.183621 Aug 24 19:37:30.954584 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 597/1212] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:30 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:31.973744 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-403a75be-43f7-4de5-9840-e4cb7bef99e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:31.974357 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-403a75be-43f7-4de5-9840-e4cb7bef99e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:31.980288 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-403a75be-43f7-4de5-9840-e4cb7bef99e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:31.980941 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-403a75be-43f7-4de5-9840-e4cb7bef99e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:31.981702 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-403a75be-43f7-4de5-9840-e4cb7bef99e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:31.982141 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-403a75be-43f7-4de5-9840-e4cb7bef99e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:32.118344 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-403a75be-43f7-4de5-9840-e4cb7bef99e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:32.131010 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-403a75be-43f7-4de5-9840-e4cb7bef99e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:32.132709 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-403a75be-43f7-4de5-9840-e4cb7bef99e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:32.133854 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-403a75be-43f7-4de5-9840-e4cb7bef99e7 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1731 microversion: 2.20 time: 0.164076 Aug 24 19:37:32.134402 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 616/1213] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:31 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:33.152253 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9553f537-ae91-46fe-8e17-7da92d684c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:37:33.153042 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9553f537-ae91-46fe-8e17-7da92d684c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:37:33.162066 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9553f537-ae91-46fe-8e17-7da92d684c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:33.162573 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9553f537-ae91-46fe-8e17-7da92d684c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:33.163359 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9553f537-ae91-46fe-8e17-7da92d684c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:37:33.163868 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9553f537-ae91-46fe-8e17-7da92d684c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:37:33.312084 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9553f537-ae91-46fe-8e17-7da92d684c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:33.317612 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9553f537-ae91-46fe-8e17-7da92d684c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:33.319232 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9553f537-ae91-46fe-8e17-7da92d684c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:37:33.320392 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9553f537-ae91-46fe-8e17-7da92d684c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1718 microversion: 2.20 time: 0.172051 Aug 24 19:37:33.321073 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 598/1214] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:37:33 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1718 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:37:48.785051 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 19:37:48.788845 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: Tue Aug 24 19:37:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 19:38:12.258497 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-bf47d0dd-8a56-4bca-9656-e27e77e705cd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:12.261654 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-bf47d0dd-8a56-4bca-9656-e27e77e705cd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:12.266571 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bf47d0dd-8a56-4bca-9656-e27e77e705cd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:12.267017 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bf47d0dd-8a56-4bca-9656-e27e77e705cd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:12.267792 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bf47d0dd-8a56-4bca-9656-e27e77e705cd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:12.268324 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bf47d0dd-8a56-4bca-9656-e27e77e705cd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:12.297169 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-bf47d0dd-8a56-4bca-9656-e27e77e705cd tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042535 Aug 24 19:38:12.297730 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 617/1215] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Aug 24 19:38:12 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:38:12.359402 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-7ac90819-f95b-4a6f-8e7f-d4ec7e7cb540 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:12.359956 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-7ac90819-f95b-4a6f-8e7f-d4ec7e7cb540 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:12.366207 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7ac90819-f95b-4a6f-8e7f-d4ec7e7cb540 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:12.366657 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7ac90819-f95b-4a6f-8e7f-d4ec7e7cb540 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:12.367436 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7ac90819-f95b-4a6f-8e7f-d4ec7e7cb540 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:12.367874 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-7ac90819-f95b-4a6f-8e7f-d4ec7e7cb540 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:12.394571 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-7ac90819-f95b-4a6f-8e7f-d4ec7e7cb540 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Going to try to terminate instance {{(pid=108908) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:38:12.850604 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-7ac90819-f95b-4a6f-8e7f-d4ec7e7cb540 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "DELETE /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 204 len: 0 microversion: 2.20 time: 0.494873 Aug 24 19:38:12.851107 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 599/1216] 10.222.0.59 () {60 vars in 1280 bytes} [Tue Aug 24 19:38:12 2021] DELETE /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 19:38:12.859693 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-4a7dabf5-7111-43ab-b291-1f8e009a9601 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:12.860309 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-4a7dabf5-7111-43ab-b291-1f8e009a9601 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:12.869134 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4a7dabf5-7111-43ab-b291-1f8e009a9601 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:12.869134 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4a7dabf5-7111-43ab-b291-1f8e009a9601 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:12.869134 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4a7dabf5-7111-43ab-b291-1f8e009a9601 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:12.869134 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-4a7dabf5-7111-43ab-b291-1f8e009a9601 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:12.994554 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4a7dabf5-7111-43ab-b291-1f8e009a9601 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:38:13.002494 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4a7dabf5-7111-43ab-b291-1f8e009a9601 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:38:13.003956 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-4a7dabf5-7111-43ab-b291-1f8e009a9601 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:38:13.005105 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-4a7dabf5-7111-43ab-b291-1f8e009a9601 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1724 microversion: 2.20 time: 0.149738 Aug 24 19:38:13.005662 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 618/1217] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:38:12 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:38:14.025670 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-119dcf6e-8efc-4b56-a5ab-a2787e6e116b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:14.026501 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-119dcf6e-8efc-4b56-a5ab-a2787e6e116b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:14.032427 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-119dcf6e-8efc-4b56-a5ab-a2787e6e116b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:14.032871 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-119dcf6e-8efc-4b56-a5ab-a2787e6e116b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:14.033645 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-119dcf6e-8efc-4b56-a5ab-a2787e6e116b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:14.034073 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-119dcf6e-8efc-4b56-a5ab-a2787e6e116b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:14.154948 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-119dcf6e-8efc-4b56-a5ab-a2787e6e116b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:38:14.162797 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-119dcf6e-8efc-4b56-a5ab-a2787e6e116b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:38:14.164330 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-119dcf6e-8efc-4b56-a5ab-a2787e6e116b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:38:14.165581 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-119dcf6e-8efc-4b56-a5ab-a2787e6e116b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1724 microversion: 2.20 time: 0.145257 Aug 24 19:38:14.166138 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 600/1218] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:38:14 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:38:15.184705 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-75c8ba2f-2749-4759-8d75-35c986ec9963 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:15.185257 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-75c8ba2f-2749-4759-8d75-35c986ec9963 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:15.191390 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-75c8ba2f-2749-4759-8d75-35c986ec9963 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:15.191837 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-75c8ba2f-2749-4759-8d75-35c986ec9963 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:15.192641 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-75c8ba2f-2749-4759-8d75-35c986ec9963 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:15.193069 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-75c8ba2f-2749-4759-8d75-35c986ec9963 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:15.285870 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-75c8ba2f-2749-4759-8d75-35c986ec9963 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:38:15.293983 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-75c8ba2f-2749-4759-8d75-35c986ec9963 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:38:15.295458 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-75c8ba2f-2749-4759-8d75-35c986ec9963 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ac543b87ad24d2f97a6101885753717', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06ad67d05efc48a180df2740ce5dedba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:38:15.296655 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-75c8ba2f-2749-4759-8d75-35c986ec9963 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 200 len: 1657 microversion: 2.20 time: 0.115871 Aug 24 19:38:15.297210 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 619/1219] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:38:15 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 1657 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 19:38:15.404928 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-906afa34-39f5-4908-a4ad-841f0b6b1c4d req-38a70aeb-12a9-4948-8a16-040bc1bf5b6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df7c8a14-baa7-4787-b6dd-21860c419bda", "name": "network-vif-deleted", "tag": "bdbbbe75-74f7-4905-ad5d-1fc34d1d189b"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:38:15.405911 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:38:15.405911 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:38:15.412840 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-906afa34-39f5-4908-a4ad-841f0b6b1c4d req-38a70aeb-12a9-4948-8a16-040bc1bf5b6a service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:15.413282 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-906afa34-39f5-4908-a4ad-841f0b6b1c4d req-38a70aeb-12a9-4948-8a16-040bc1bf5b6a service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:15.424400 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-906afa34-39f5-4908-a4ad-841f0b6b1c4d req-38a70aeb-12a9-4948-8a16-040bc1bf5b6a service nova] Creating event network-vif-deleted:bdbbbe75-74f7-4905-ad5d-1fc34d1d189b for instance df7c8a14-baa7-4787-b6dd-21860c419bda on hv-cinder-79819 Aug 24 19:38:15.429471 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-906afa34-39f5-4908-a4ad-841f0b6b1c4d req-38a70aeb-12a9-4948-8a16-040bc1bf5b6a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028735 Aug 24 19:38:15.430131 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 601/1220] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:38:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:38:16.315242 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e7bce737-83b6-4d3a-bc43-dcd472184cee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:16.317089 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e7bce737-83b6-4d3a-bc43-dcd472184cee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:16.323309 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e7bce737-83b6-4d3a-bc43-dcd472184cee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:16.323750 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e7bce737-83b6-4d3a-bc43-dcd472184cee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:16.324605 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e7bce737-83b6-4d3a-bc43-dcd472184cee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:16.325030 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e7bce737-83b6-4d3a-bc43-dcd472184cee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:16.340664 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-e7bce737-83b6-4d3a-bc43-dcd472184cee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] HTTP exception thrown: Instance df7c8a14-baa7-4787-b6dd-21860c419bda could not be found. Aug 24 19:38:16.341241 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e7bce737-83b6-4d3a-bc43-dcd472184cee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Returning 404 to user: Instance df7c8a14-baa7-4787-b6dd-21860c419bda could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:38:16.346165 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e7bce737-83b6-4d3a-bc43-dcd472184cee tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 404 len: 111 microversion: 2.20 time: 0.030955 Aug 24 19:38:16.346165 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 620/1221] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Aug 24 19:38:16 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 19:38:16.352385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-486fe581-8184-4329-a90d-615a8e30c176 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '.version_select at 0x7f8df72ed280>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:16.474442 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-486fe581-8184-4329-a90d-615a8e30c176 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181257249" status: 204 len: 0 microversion: 2.20 time: 0.126245 Aug 24 19:38:16.475143 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 602/1222] 10.222.0.59 () {60 vars in 1262 bytes} [Tue Aug 24 19:38:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181257249 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 19:38:18.664212 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-378fff84-4ea6-4380-ab4f-b5c5f2a399f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:18.664732 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-378fff84-4ea6-4380-ab4f-b5c5f2a399f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:18.671164 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-378fff84-4ea6-4380-ab4f-b5c5f2a399f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:18.671609 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-378fff84-4ea6-4380-ab4f-b5c5f2a399f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:18.672409 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-378fff84-4ea6-4380-ab4f-b5c5f2a399f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:18.672839 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-378fff84-4ea6-4380-ab4f-b5c5f2a399f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:18.686421 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-378fff84-4ea6-4380-ab4f-b5c5f2a399f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] HTTP exception thrown: Instance df7c8a14-baa7-4787-b6dd-21860c419bda could not be found. Aug 24 19:38:18.686997 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-378fff84-4ea6-4380-ab4f-b5c5f2a399f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Returning 404 to user: Instance df7c8a14-baa7-4787-b6dd-21860c419bda could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:38:18.687802 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-378fff84-4ea6-4380-ab4f-b5c5f2a399f9 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "DELETE /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 404 len: 111 microversion: 2.1 time: 0.027359 Aug 24 19:38:18.688339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 621/1223] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:38:18 2021] DELETE /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:38:18.696121 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d2337bcf-a056-42c4-b112-b846e5d17827 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:18.696929 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d2337bcf-a056-42c4-b112-b846e5d17827 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: df7c8a14-baa7-4787-b6dd-21860c419bda] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:18.703312 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d2337bcf-a056-42c4-b112-b846e5d17827 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:18.703762 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d2337bcf-a056-42c4-b112-b846e5d17827 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:18.704596 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d2337bcf-a056-42c4-b112-b846e5d17827 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:18.705079 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d2337bcf-a056-42c4-b112-b846e5d17827 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:18.718401 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-d2337bcf-a056-42c4-b112-b846e5d17827 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] HTTP exception thrown: Instance df7c8a14-baa7-4787-b6dd-21860c419bda could not be found. Aug 24 19:38:18.719036 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d2337bcf-a056-42c4-b112-b846e5d17827 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Returning 404 to user: Instance df7c8a14-baa7-4787-b6dd-21860c419bda could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:38:18.719967 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d2337bcf-a056-42c4-b112-b846e5d17827 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda" status: 404 len: 111 microversion: 2.1 time: 0.027600 Aug 24 19:38:18.720615 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 603/1224] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:38:18 2021] GET /compute/v2.1/servers/df7c8a14-baa7-4787-b6dd-21860c419bda => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:38:20.037329 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f88ada02-25db-431c-8b95-87a94a714c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:20.037887 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f88ada02-25db-431c-8b95-87a94a714c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:20.044692 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f88ada02-25db-431c-8b95-87a94a714c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:20.045209 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f88ada02-25db-431c-8b95-87a94a714c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:20.046038 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f88ada02-25db-431c-8b95-87a94a714c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:20.046541 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f88ada02-25db-431c-8b95-87a94a714c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:20.060130 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-f88ada02-25db-431c-8b95-87a94a714c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] HTTP exception thrown: Instance 7c70c776-ec7a-4970-9d9f-baf8c6568257 could not be found. Aug 24 19:38:20.060747 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f88ada02-25db-431c-8b95-87a94a714c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Returning 404 to user: Instance 7c70c776-ec7a-4970-9d9f-baf8c6568257 could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:38:20.061688 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f88ada02-25db-431c-8b95-87a94a714c8b tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 404 len: 111 microversion: 2.1 time: 0.028331 Aug 24 19:38:20.062230 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 622/1225] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:38:20 2021] DELETE /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 19:38:20.074818 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-804defbc-f4a6-4e08-af80-174fdb26ae36 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:20.075429 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-804defbc-f4a6-4e08-af80-174fdb26ae36 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] [instance: 7c70c776-ec7a-4970-9d9f-baf8c6568257] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:20.081278 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-804defbc-f4a6-4e08-af80-174fdb26ae36 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:20.081727 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-804defbc-f4a6-4e08-af80-174fdb26ae36 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:20.082496 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-804defbc-f4a6-4e08-af80-174fdb26ae36 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:20.082930 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-804defbc-f4a6-4e08-af80-174fdb26ae36 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:20.097437 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-804defbc-f4a6-4e08-af80-174fdb26ae36 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] HTTP exception thrown: Instance 7c70c776-ec7a-4970-9d9f-baf8c6568257 could not be found. Aug 24 19:38:20.098189 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-804defbc-f4a6-4e08-af80-174fdb26ae36 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] Returning 404 to user: Instance 7c70c776-ec7a-4970-9d9f-baf8c6568257 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:38:20.103577 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-804defbc-f4a6-4e08-af80-174fdb26ae36 tempest-AttachVolumeShelveTestJSON-814307311 tempest-AttachVolumeShelveTestJSON-814307311-project] 10.222.0.59 "GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257" status: 404 len: 111 microversion: 2.1 time: 0.028095 Aug 24 19:38:20.103577 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 604/1226] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:38:20 2021] GET /compute/v2.1/servers/7c70c776-ec7a-4970-9d9f-baf8c6568257 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:38:45.783130 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-3ac2d94a-3901-4f37-8600-c4e1c663e229 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:45.784132 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3ac2d94a-3901-4f37-8600-c4e1c663e229 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:45.785880 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-ede512e6-5d11-442c-b21d-8113325288e2 req-48ecec3b-dbf9-4e64-965c-48de9b4d75ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff70d818-92c2-45bf-b298-96a45eb576a3", "tag": "9eae3e9d-b91a-4a71-8862-9ab8e3b42579"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:38:45.787424 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:38:45.787424 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:38:45.790708 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3ac2d94a-3901-4f37-8600-c4e1c663e229 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:45.793600 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3ac2d94a-3901-4f37-8600-c4e1c663e229 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:45.793600 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3ac2d94a-3901-4f37-8600-c4e1c663e229 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:45.793600 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-3ac2d94a-3901-4f37-8600-c4e1c663e229 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:45.795853 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-ede512e6-5d11-442c-b21d-8113325288e2 req-48ecec3b-dbf9-4e64-965c-48de9b4d75ce service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:45.796314 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-ede512e6-5d11-442c-b21d-8113325288e2 req-48ecec3b-dbf9-4e64-965c-48de9b4d75ce service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:45.808283 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-ede512e6-5d11-442c-b21d-8113325288e2 req-48ecec3b-dbf9-4e64-965c-48de9b4d75ce service nova] Creating event network-changed:9eae3e9d-b91a-4a71-8862-9ab8e3b42579 for instance ff70d818-92c2-45bf-b298-96a45eb576a3 on hv-cinder-79819 Aug 24 19:38:45.813696 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-ede512e6-5d11-442c-b21d-8113325288e2 req-48ecec3b-dbf9-4e64-965c-48de9b4d75ce service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031860 Aug 24 19:38:45.814473 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 605/1227] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:38:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:38:45.819724 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-3ac2d94a-3901-4f37-8600-c4e1c663e229 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Going to try to terminate instance {{(pid=108907) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:38:46.224414 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-3ac2d94a-3901-4f37-8600-c4e1c663e229 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 204 len: 0 microversion: 2.1 time: 0.444890 Aug 24 19:38:46.225000 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 623/1228] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:38:45 2021] DELETE /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:38:46.235042 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-924476b3-95b7-4fab-a51a-9c5496b33a6b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:46.235745 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-924476b3-95b7-4fab-a51a-9c5496b33a6b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:46.242287 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-924476b3-95b7-4fab-a51a-9c5496b33a6b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:46.242885 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-924476b3-95b7-4fab-a51a-9c5496b33a6b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:46.243667 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-924476b3-95b7-4fab-a51a-9c5496b33a6b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:46.244149 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-924476b3-95b7-4fab-a51a-9c5496b33a6b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:46.416786 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-924476b3-95b7-4fab-a51a-9c5496b33a6b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:38:46.424300 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-924476b3-95b7-4fab-a51a-9c5496b33a6b tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1567 microversion: 2.1 time: 0.193594 Aug 24 19:38:46.424866 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 606/1229] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:38:46 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:38:47.442630 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-96fe6665-590e-4503-8c18-cfc7e6e3c516 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:47.443422 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-96fe6665-590e-4503-8c18-cfc7e6e3c516 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:47.450095 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-96fe6665-590e-4503-8c18-cfc7e6e3c516 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:47.450541 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-96fe6665-590e-4503-8c18-cfc7e6e3c516 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:47.451304 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-96fe6665-590e-4503-8c18-cfc7e6e3c516 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:47.451766 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-96fe6665-590e-4503-8c18-cfc7e6e3c516 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:47.574398 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-96fe6665-590e-4503-8c18-cfc7e6e3c516 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:38:47.579041 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-96fe6665-590e-4503-8c18-cfc7e6e3c516 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1449 microversion: 2.1 time: 0.140434 Aug 24 19:38:47.579609 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 624/1230] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:38:47 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1449 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:38:48.367856 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-0fdabcd2-9531-4cf8-ac1c-99f1a3d56e27 req-25d7392c-0dd4-4a4c-9098-2e14109beb58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff70d818-92c2-45bf-b298-96a45eb576a3", "name": "network-vif-deleted", "tag": "9eae3e9d-b91a-4a71-8862-9ab8e3b42579"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:38:48.369366 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:38:48.369366 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:38:48.376128 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-0fdabcd2-9531-4cf8-ac1c-99f1a3d56e27 req-25d7392c-0dd4-4a4c-9098-2e14109beb58 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:48.376604 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-0fdabcd2-9531-4cf8-ac1c-99f1a3d56e27 req-25d7392c-0dd4-4a4c-9098-2e14109beb58 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:48.387517 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-0fdabcd2-9531-4cf8-ac1c-99f1a3d56e27 req-25d7392c-0dd4-4a4c-9098-2e14109beb58 service nova] Creating event network-vif-deleted:9eae3e9d-b91a-4a71-8862-9ab8e3b42579 for instance ff70d818-92c2-45bf-b298-96a45eb576a3 on hv-cinder-79819 Aug 24 19:38:48.392307 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-0fdabcd2-9531-4cf8-ac1c-99f1a3d56e27 req-25d7392c-0dd4-4a4c-9098-2e14109beb58 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028257 Aug 24 19:38:48.394815 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 607/1231] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:38:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:38:48.597245 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5b8c5b51-4eee-4d73-a56b-41b4481b3c44 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:48.597782 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5b8c5b51-4eee-4d73-a56b-41b4481b3c44 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:48.604508 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5b8c5b51-4eee-4d73-a56b-41b4481b3c44 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:48.604951 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5b8c5b51-4eee-4d73-a56b-41b4481b3c44 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:48.605715 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5b8c5b51-4eee-4d73-a56b-41b4481b3c44 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:48.606146 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5b8c5b51-4eee-4d73-a56b-41b4481b3c44 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:48.666707 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5b8c5b51-4eee-4d73-a56b-41b4481b3c44 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:38:48.674724 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5b8c5b51-4eee-4d73-a56b-41b4481b3c44 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1218 microversion: 2.1 time: 0.081161 Aug 24 19:38:48.675302 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 625/1232] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:38:48 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:38:49.691789 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-dfbf77a0-5b6a-4060-8c23-d5103f48ae41 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:49.692504 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-dfbf77a0-5b6a-4060-8c23-d5103f48ae41 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:49.698409 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfbf77a0-5b6a-4060-8c23-d5103f48ae41 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:49.699966 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfbf77a0-5b6a-4060-8c23-d5103f48ae41 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:49.699966 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfbf77a0-5b6a-4060-8c23-d5103f48ae41 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:49.700180 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfbf77a0-5b6a-4060-8c23-d5103f48ae41 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:49.730887 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfbf77a0-5b6a-4060-8c23-d5103f48ae41 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:49.731326 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfbf77a0-5b6a-4060-8c23-d5103f48ae41 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:49.731767 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.objects.instance [None req-dfbf77a0-5b6a-4060-8c23-d5103f48ae41 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lazy-loading 'fault' on Instance uuid ff70d818-92c2-45bf-b298-96a45eb576a3 {{(pid=108908) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:38:49.770377 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-dfbf77a0-5b6a-4060-8c23-d5103f48ae41 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '370ccbd2eb144262b58fd4dd35f391f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c635296755b449db8c99cc0b86f4702f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:38:49.778252 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-dfbf77a0-5b6a-4060-8c23-d5103f48ae41 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 200 len: 1223 microversion: 2.1 time: 0.090546 Aug 24 19:38:49.778835 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 608/1233] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:38:49 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:38:50.794939 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d5b4f431-fe8e-4d04-81db-86050c3ee48f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:50.795539 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-d5b4f431-fe8e-4d04-81db-86050c3ee48f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] [instance: ff70d818-92c2-45bf-b298-96a45eb576a3] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:38:50.801435 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d5b4f431-fe8e-4d04-81db-86050c3ee48f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:50.801879 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d5b4f431-fe8e-4d04-81db-86050c3ee48f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:50.802631 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d5b4f431-fe8e-4d04-81db-86050c3ee48f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:38:50.803080 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-d5b4f431-fe8e-4d04-81db-86050c3ee48f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:38:50.816734 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-d5b4f431-fe8e-4d04-81db-86050c3ee48f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] HTTP exception thrown: Instance ff70d818-92c2-45bf-b298-96a45eb576a3 could not be found. Aug 24 19:38:50.817317 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-d5b4f431-fe8e-4d04-81db-86050c3ee48f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Returning 404 to user: Instance ff70d818-92c2-45bf-b298-96a45eb576a3 could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:38:50.818149 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-d5b4f431-fe8e-4d04-81db-86050c3ee48f tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3" status: 404 len: 111 microversion: 2.1 time: 0.026860 Aug 24 19:38:50.818661 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 626/1234] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:38:50 2021] GET /compute/v2.1/servers/ff70d818-92c2-45bf-b298-96a45eb576a3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:38:51.090878 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-402227e5-8905-4072-9b7e-68fac7434149 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] Calling method '.version_select at 0x7f8df7254c10>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:38:51.232158 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-402227e5-8905-4072-9b7e-68fac7434149 tempest-TestShelveInstance-1625006438 tempest-TestShelveInstance-1625006438-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-948258038" status: 202 len: 0 microversion: 2.1 time: 0.144870 Aug 24 19:38:51.232784 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 609/1235] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Aug 24 19:38:51 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-948258038 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:39:15.194778 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: ERROR oslo.messaging._drivers.impl_rabbit [-] [549a2371-dff1-41c9-8c68-7d128b2598e0] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 19:39:15.383604 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-2feee1f8-1f5f-4833-946a-fd9bcfefbe08 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Action: 'create', calling method: .version_select at 0x7f8df73b4c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1536662292"}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:39:15.401308 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-2feee1f8-1f5f-4833-946a-fd9bcfefbe08 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Getting quotas for project e2be3a7831b54615af1b92b62f673658. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:39:15.409892 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-2feee1f8-1f5f-4833-946a-fd9bcfefbe08 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Getting quotas for user a6000c097b514930871a9f590134104e and project e2be3a7831b54615af1b92b62f673658. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:39:16.002877 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-2feee1f8-1f5f-4833-946a-fd9bcfefbe08 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Getting quotas for project e2be3a7831b54615af1b92b62f673658. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:39:16.006567 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-2feee1f8-1f5f-4833-946a-fd9bcfefbe08 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Getting quotas for user a6000c097b514930871a9f590134104e and project e2be3a7831b54615af1b92b62f673658. Resources: {'key_pairs'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:39:16.019321 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-2feee1f8-1f5f-4833-946a-fd9bcfefbe08 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.830714 Aug 24 19:39:16.019919 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 627/1236] 10.222.0.59 () {60 vars in 1158 bytes} [Tue Aug 24 19:39:15 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:35.640487 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f64552f4-747f-4922-ba77-da26c94d1fc1] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 19:39:35.643845 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1189718397", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1536662292", "security_groups": [{"name": "tempest-secgroup-smoke-2064559475"}], "block_device_mapping_v2": [{"uuid": "988f836d-5f6e-4cf5-9811-2c1281e5ddc7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "91be4c16-b034-417f-ad7a-a8f3aa634a34"}]}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:39:35.746171 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.network.neutron [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] validate_networks() for [('91be4c16-b034-417f-ad7a-a8f3aa634a34', None, None, None, None, None)] {{(pid=108908) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:39:36.107507 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Flavor limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:39:36.108051 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Image limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:39:36.108654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Flavor pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:39:36.109079 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Image pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:39:36.109491 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:39:36.118382 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:36.118829 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:36.119724 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:36.120163 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:36.136344 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Getting quotas for project e2be3a7831b54615af1b92b62f673658. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:39:36.140495 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Getting quotas for user a6000c097b514930871a9f590134104e and project e2be3a7831b54615af1b92b62f673658. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:39:36.201262 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Going to run 1 instances... {{(pid=108908) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:39:36.203481 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='988f836d-5f6e-4cf5-9811-2c1281e5ddc7',volume_size=None,volume_type=None)] {{(pid=108908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:39:36.657624 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO oslo.messaging._drivers.impl_rabbit [-] [f64552f4-747f-4922-ba77-da26c94d1fc1] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 36786. Aug 24 19:39:36.965009 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-04ff60be-a7a0-448a-8e1a-6b591d9b1285 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.325914 Aug 24 19:39:36.965674 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 610/1237] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:39:35 2021] POST /compute/v2.1/servers => generated 406 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:39:36.997293 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f0dc44d5-c08a-4a3a-82ad-6a08694f4b13 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:36.997898 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f0dc44d5-c08a-4a3a-82ad-6a08694f4b13 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:37.009162 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO oslo.messaging._drivers.impl_rabbit [-] [549a2371-dff1-41c9-8c68-7d128b2598e0] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 36790. Aug 24 19:39:37.055007 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f0dc44d5-c08a-4a3a-82ad-6a08694f4b13 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:37.062909 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f0dc44d5-c08a-4a3a-82ad-6a08694f4b13 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1095 microversion: 2.1 time: 0.087526 Aug 24 19:39:37.063443 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 628/1238] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:36 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1095 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:38.079421 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-506a714d-f527-4a09-85c9-d84ae9e17dd6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:38.080078 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-506a714d-f527-4a09-85c9-d84ae9e17dd6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:38.131263 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-506a714d-f527-4a09-85c9-d84ae9e17dd6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:38.138090 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-506a714d-f527-4a09-85c9-d84ae9e17dd6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1095 microversion: 2.1 time: 0.062397 Aug 24 19:39:38.138651 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 611/1239] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:38 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:39.154873 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-662df685-d0dc-4441-a1c5-ca45133cf2d0 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:39.155483 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-662df685-d0dc-4441-a1c5-ca45133cf2d0 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:39.205766 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-662df685-d0dc-4441-a1c5-ca45133cf2d0 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:39.212443 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-662df685-d0dc-4441-a1c5-ca45133cf2d0 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1095 microversion: 2.1 time: 0.061342 Aug 24 19:39:39.213031 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 629/1240] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:39 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1095 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:40.229819 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-50415606-c1f3-4d82-acac-f85d054e355b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:40.230447 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-50415606-c1f3-4d82-acac-f85d054e355b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:40.237021 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-50415606-c1f3-4d82-acac-f85d054e355b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:40.237475 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-50415606-c1f3-4d82-acac-f85d054e355b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:40.238247 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-50415606-c1f3-4d82-acac-f85d054e355b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:40.238681 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-50415606-c1f3-4d82-acac-f85d054e355b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:40.296773 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-50415606-c1f3-4d82-acac-f85d054e355b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:40.304153 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-50415606-c1f3-4d82-acac-f85d054e355b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1145 microversion: 2.1 time: 0.078032 Aug 24 19:39:40.304750 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 612/1241] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:40 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1145 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:41.321565 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8bbb862a-3e85-4f79-9fa1-91f91aede1af tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:41.322269 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8bbb862a-3e85-4f79-9fa1-91f91aede1af tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:41.328141 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8bbb862a-3e85-4f79-9fa1-91f91aede1af tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:41.328617 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8bbb862a-3e85-4f79-9fa1-91f91aede1af tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:41.329374 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8bbb862a-3e85-4f79-9fa1-91f91aede1af tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:41.329804 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8bbb862a-3e85-4f79-9fa1-91f91aede1af tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:41.388205 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8bbb862a-3e85-4f79-9fa1-91f91aede1af tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:41.395762 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8bbb862a-3e85-4f79-9fa1-91f91aede1af tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1193 microversion: 2.1 time: 0.078092 Aug 24 19:39:41.396916 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 630/1242] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:41 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1193 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:42.412858 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8b698beb-8ded-4ef5-8d3e-bb8ee539186a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:42.413536 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8b698beb-8ded-4ef5-8d3e-bb8ee539186a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:42.419818 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8b698beb-8ded-4ef5-8d3e-bb8ee539186a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:42.420726 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8b698beb-8ded-4ef5-8d3e-bb8ee539186a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:42.421733 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8b698beb-8ded-4ef5-8d3e-bb8ee539186a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:42.422177 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8b698beb-8ded-4ef5-8d3e-bb8ee539186a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:42.643622 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8b698beb-8ded-4ef5-8d3e-bb8ee539186a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:42.651456 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8b698beb-8ded-4ef5-8d3e-bb8ee539186a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1279 microversion: 2.1 time: 0.242359 Aug 24 19:39:42.652043 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 613/1243] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:42 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:43.271030 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-f5009f1b-42ce-4f55-9714-ff7a68cc892d req-c73cbd11-54ec-4623-ad81-ee41a45aa1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ee58430-380a-4eb6-8413-5259275420f4", "tag": "277fb2fb-5c32-4b98-8d00-12815b1a5b8c"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:39:43.273375 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:39:43.273375 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:39:43.280746 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-f5009f1b-42ce-4f55-9714-ff7a68cc892d req-c73cbd11-54ec-4623-ad81-ee41a45aa1d6 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:43.281260 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-f5009f1b-42ce-4f55-9714-ff7a68cc892d req-c73cbd11-54ec-4623-ad81-ee41a45aa1d6 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:43.293942 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-f5009f1b-42ce-4f55-9714-ff7a68cc892d req-c73cbd11-54ec-4623-ad81-ee41a45aa1d6 service nova] Creating event network-changed:277fb2fb-5c32-4b98-8d00-12815b1a5b8c for instance 6ee58430-380a-4eb6-8413-5259275420f4 on hv-cinder-79819 Aug 24 19:39:43.299290 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-f5009f1b-42ce-4f55-9714-ff7a68cc892d req-c73cbd11-54ec-4623-ad81-ee41a45aa1d6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032446 Aug 24 19:39:43.299908 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 631/1244] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:39:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:39:43.672017 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-99ba5554-1d51-4e9e-8dd6-85b9ace8abf3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:43.672768 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-99ba5554-1d51-4e9e-8dd6-85b9ace8abf3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:43.678664 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-99ba5554-1d51-4e9e-8dd6-85b9ace8abf3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:43.679115 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-99ba5554-1d51-4e9e-8dd6-85b9ace8abf3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:43.679893 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-99ba5554-1d51-4e9e-8dd6-85b9ace8abf3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:43.680348 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-99ba5554-1d51-4e9e-8dd6-85b9ace8abf3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:43.849728 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-99ba5554-1d51-4e9e-8dd6-85b9ace8abf3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:43.857644 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-99ba5554-1d51-4e9e-8dd6-85b9ace8abf3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1267 microversion: 2.1 time: 0.189387 Aug 24 19:39:43.858224 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 614/1245] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:43 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:44.875968 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8d846dd4-4e87-48e6-ac24-6dd7f6bcda6c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:44.876688 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8d846dd4-4e87-48e6-ac24-6dd7f6bcda6c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:44.883484 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d846dd4-4e87-48e6-ac24-6dd7f6bcda6c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:44.883932 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d846dd4-4e87-48e6-ac24-6dd7f6bcda6c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:44.884734 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d846dd4-4e87-48e6-ac24-6dd7f6bcda6c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:44.885166 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8d846dd4-4e87-48e6-ac24-6dd7f6bcda6c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:45.011639 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8d846dd4-4e87-48e6-ac24-6dd7f6bcda6c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:45.019122 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8d846dd4-4e87-48e6-ac24-6dd7f6bcda6c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1267 microversion: 2.1 time: 0.147290 Aug 24 19:39:45.019681 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 632/1246] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:44 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:46.036536 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-fc3136b7-f4d3-4192-9a21-c62980d4a4d2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:46.037128 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-fc3136b7-f4d3-4192-9a21-c62980d4a4d2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:46.043724 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fc3136b7-f4d3-4192-9a21-c62980d4a4d2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:46.044182 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fc3136b7-f4d3-4192-9a21-c62980d4a4d2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:46.045004 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fc3136b7-f4d3-4192-9a21-c62980d4a4d2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:46.045448 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fc3136b7-f4d3-4192-9a21-c62980d4a4d2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:46.165324 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-fc3136b7-f4d3-4192-9a21-c62980d4a4d2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:46.174708 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-fc3136b7-f4d3-4192-9a21-c62980d4a4d2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1267 microversion: 2.1 time: 0.142019 Aug 24 19:39:46.175276 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 615/1247] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:46 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:47.191375 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5bb7663b-9679-452e-b813-8c814c1e2ccb tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:47.191922 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5bb7663b-9679-452e-b813-8c814c1e2ccb tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:47.197921 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5bb7663b-9679-452e-b813-8c814c1e2ccb tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:47.198398 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5bb7663b-9679-452e-b813-8c814c1e2ccb tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:47.199155 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5bb7663b-9679-452e-b813-8c814c1e2ccb tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:47.199591 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-5bb7663b-9679-452e-b813-8c814c1e2ccb tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:47.319672 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5bb7663b-9679-452e-b813-8c814c1e2ccb tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:47.327051 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5bb7663b-9679-452e-b813-8c814c1e2ccb tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1267 microversion: 2.1 time: 0.139388 Aug 24 19:39:47.327618 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 633/1248] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:47 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:48.344093 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8ced9f1c-166c-4f35-ae77-fd10a743568d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:48.344707 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8ced9f1c-166c-4f35-ae77-fd10a743568d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:48.350535 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8ced9f1c-166c-4f35-ae77-fd10a743568d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:48.350978 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8ced9f1c-166c-4f35-ae77-fd10a743568d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:48.351732 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8ced9f1c-166c-4f35-ae77-fd10a743568d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:48.352167 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8ced9f1c-166c-4f35-ae77-fd10a743568d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:48.468895 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8ced9f1c-166c-4f35-ae77-fd10a743568d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:48.476082 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8ced9f1c-166c-4f35-ae77-fd10a743568d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1267 microversion: 2.1 time: 0.136134 Aug 24 19:39:48.476674 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 616/1249] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:48 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:49.493378 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-cdb7323b-780f-4d77-9468-f7f30565100b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:49.493967 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-cdb7323b-780f-4d77-9468-f7f30565100b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:49.499761 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cdb7323b-780f-4d77-9468-f7f30565100b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:49.500201 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cdb7323b-780f-4d77-9468-f7f30565100b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:49.500986 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cdb7323b-780f-4d77-9468-f7f30565100b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:49.501415 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-cdb7323b-780f-4d77-9468-f7f30565100b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:49.622645 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-cdb7323b-780f-4d77-9468-f7f30565100b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:49.630454 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-cdb7323b-780f-4d77-9468-f7f30565100b tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1267 microversion: 2.1 time: 0.140777 Aug 24 19:39:49.631018 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 634/1250] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:49 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:50.647682 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-9d87c23c-3926-467c-a910-14b7f4798e44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:50.648354 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-9d87c23c-3926-467c-a910-14b7f4798e44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:50.654172 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9d87c23c-3926-467c-a910-14b7f4798e44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:50.654622 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9d87c23c-3926-467c-a910-14b7f4798e44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:50.655385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9d87c23c-3926-467c-a910-14b7f4798e44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:50.655819 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-9d87c23c-3926-467c-a910-14b7f4798e44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:50.780634 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-9d87c23c-3926-467c-a910-14b7f4798e44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:50.788739 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-9d87c23c-3926-467c-a910-14b7f4798e44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1267 microversion: 2.1 time: 0.144734 Aug 24 19:39:50.789320 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 617/1251] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:50 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:51.805388 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-1dd9ab58-9f34-4a68-bb80-6a6b6a4219ac tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:51.805991 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-1dd9ab58-9f34-4a68-bb80-6a6b6a4219ac tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:51.811891 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1dd9ab58-9f34-4a68-bb80-6a6b6a4219ac tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:51.812371 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1dd9ab58-9f34-4a68-bb80-6a6b6a4219ac tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:51.813132 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1dd9ab58-9f34-4a68-bb80-6a6b6a4219ac tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:51.813564 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-1dd9ab58-9f34-4a68-bb80-6a6b6a4219ac tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:51.930988 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-1dd9ab58-9f34-4a68-bb80-6a6b6a4219ac tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:51.938319 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-1dd9ab58-9f34-4a68-bb80-6a6b6a4219ac tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1267 microversion: 2.1 time: 0.136683 Aug 24 19:39:51.938884 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 635/1252] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:51 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:52.954976 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3957de48-a705-4c05-9a35-c7718eb79e38 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:52.955588 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3957de48-a705-4c05-9a35-c7718eb79e38 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:52.962269 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3957de48-a705-4c05-9a35-c7718eb79e38 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:52.962715 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3957de48-a705-4c05-9a35-c7718eb79e38 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:52.963471 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3957de48-a705-4c05-9a35-c7718eb79e38 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:52.963897 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3957de48-a705-4c05-9a35-c7718eb79e38 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:53.084072 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-3957de48-a705-4c05-9a35-c7718eb79e38 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:53.091914 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3957de48-a705-4c05-9a35-c7718eb79e38 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1267 microversion: 2.1 time: 0.140659 Aug 24 19:39:53.092544 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 618/1253] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:52 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:54.109282 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-72069f12-7ad6-4552-a59d-5ab3b67eae3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:54.109850 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-72069f12-7ad6-4552-a59d-5ab3b67eae3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:54.115472 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-72069f12-7ad6-4552-a59d-5ab3b67eae3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:54.115917 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-72069f12-7ad6-4552-a59d-5ab3b67eae3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:54.116713 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-72069f12-7ad6-4552-a59d-5ab3b67eae3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:54.117135 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-72069f12-7ad6-4552-a59d-5ab3b67eae3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:54.236926 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-72069f12-7ad6-4552-a59d-5ab3b67eae3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:54.244110 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-72069f12-7ad6-4552-a59d-5ab3b67eae3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1267 microversion: 2.1 time: 0.138566 Aug 24 19:39:54.244705 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 636/1254] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:54 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:55.260842 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2bbaed7e-cc73-4b93-80f3-bde6b4be999a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:55.261450 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2bbaed7e-cc73-4b93-80f3-bde6b4be999a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:55.267304 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2bbaed7e-cc73-4b93-80f3-bde6b4be999a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:55.267746 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2bbaed7e-cc73-4b93-80f3-bde6b4be999a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:55.268531 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2bbaed7e-cc73-4b93-80f3-bde6b4be999a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:55.268959 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2bbaed7e-cc73-4b93-80f3-bde6b4be999a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:55.391253 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-2bbaed7e-cc73-4b93-80f3-bde6b4be999a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:55.398989 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2bbaed7e-cc73-4b93-80f3-bde6b4be999a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1267 microversion: 2.1 time: 0.141730 Aug 24 19:39:55.399610 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 619/1255] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:55 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:55.687232 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-e3f45a91-b79d-45de-ac79-afc12e38da4f req-9eac0c60-c717-4a76-8f43-f21b1a31290a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee58430-380a-4eb6-8413-5259275420f4", "name": "network-vif-plugged", "status": "completed", "tag": "277fb2fb-5c32-4b98-8d00-12815b1a5b8c"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:39:55.688832 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:39:55.688832 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:39:55.695713 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-e3f45a91-b79d-45de-ac79-afc12e38da4f req-9eac0c60-c717-4a76-8f43-f21b1a31290a service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:55.696156 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-e3f45a91-b79d-45de-ac79-afc12e38da4f req-9eac0c60-c717-4a76-8f43-f21b1a31290a service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:55.707309 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-e3f45a91-b79d-45de-ac79-afc12e38da4f req-9eac0c60-c717-4a76-8f43-f21b1a31290a service nova] Creating event network-vif-plugged:277fb2fb-5c32-4b98-8d00-12815b1a5b8c for instance 6ee58430-380a-4eb6-8413-5259275420f4 on hv-cinder-79819 Aug 24 19:39:55.712233 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-e3f45a91-b79d-45de-ac79-afc12e38da4f req-9eac0c60-c717-4a76-8f43-f21b1a31290a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028725 Aug 24 19:39:55.712842 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 637/1256] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:39:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:39:56.416372 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-fcaaed08-8402-4a9f-a89f-5db7d7e046ab tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:56.416967 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-fcaaed08-8402-4a9f-a89f-5db7d7e046ab tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:56.422851 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fcaaed08-8402-4a9f-a89f-5db7d7e046ab tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:56.423302 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fcaaed08-8402-4a9f-a89f-5db7d7e046ab tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:56.424070 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fcaaed08-8402-4a9f-a89f-5db7d7e046ab tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:56.424530 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-fcaaed08-8402-4a9f-a89f-5db7d7e046ab tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:56.542543 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-fcaaed08-8402-4a9f-a89f-5db7d7e046ab tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:56.550121 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-fcaaed08-8402-4a9f-a89f-5db7d7e046ab tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1267 microversion: 2.1 time: 0.137496 Aug 24 19:39:56.550710 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 620/1257] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:56 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:57.567659 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b3dd7aca-358f-46a2-9af4-fbe17b9dbbf7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:57.568389 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b3dd7aca-358f-46a2-9af4-fbe17b9dbbf7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:57.575097 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3dd7aca-358f-46a2-9af4-fbe17b9dbbf7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:57.575575 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3dd7aca-358f-46a2-9af4-fbe17b9dbbf7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:57.576435 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3dd7aca-358f-46a2-9af4-fbe17b9dbbf7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:57.576906 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b3dd7aca-358f-46a2-9af4-fbe17b9dbbf7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:57.698092 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-b3dd7aca-358f-46a2-9af4-fbe17b9dbbf7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:57.705913 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b3dd7aca-358f-46a2-9af4-fbe17b9dbbf7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1453 microversion: 2.1 time: 0.142580 Aug 24 19:39:57.706475 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 638/1258] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:57 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1453 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:57.722022 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-8943d69e-beed-41c6-94f4-4e38b1a14983 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:39:57.722629 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-8943d69e-beed-41c6-94f4-4e38b1a14983 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:39:57.728601 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8943d69e-beed-41c6-94f4-4e38b1a14983 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:57.729051 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8943d69e-beed-41c6-94f4-4e38b1a14983 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:57.729813 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8943d69e-beed-41c6-94f4-4e38b1a14983 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:57.730242 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-8943d69e-beed-41c6-94f4-4e38b1a14983 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:57.853571 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-8943d69e-beed-41c6-94f4-4e38b1a14983 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:39:57.860968 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-8943d69e-beed-41c6-94f4-4e38b1a14983 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1453 microversion: 2.1 time: 0.142588 Aug 24 19:39:57.861546 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 621/1259] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:39:57 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1453 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:39:59.938740 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-6e3a64e5-9326-4cac-b386-c513aaa88d1c req-71ad136a-12d2-460d-8ecd-6c18ddfaff36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ee58430-380a-4eb6-8413-5259275420f4", "tag": "277fb2fb-5c32-4b98-8d00-12815b1a5b8c"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:39:59.940223 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:39:59.940223 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:39:59.947341 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-6e3a64e5-9326-4cac-b386-c513aaa88d1c req-71ad136a-12d2-460d-8ecd-6c18ddfaff36 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:39:59.947775 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-6e3a64e5-9326-4cac-b386-c513aaa88d1c req-71ad136a-12d2-460d-8ecd-6c18ddfaff36 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:39:59.958834 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-6e3a64e5-9326-4cac-b386-c513aaa88d1c req-71ad136a-12d2-460d-8ecd-6c18ddfaff36 service nova] Creating event network-changed:277fb2fb-5c32-4b98-8d00-12815b1a5b8c for instance 6ee58430-380a-4eb6-8413-5259275420f4 on hv-cinder-79819 Aug 24 19:39:59.963870 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-6e3a64e5-9326-4cac-b386-c513aaa88d1c req-71ad136a-12d2-460d-8ecd-6c18ddfaff36 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028728 Aug 24 19:39:59.964545 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 639/1260] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:39:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:40:06.273988 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 19:40:06.274662 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: Tue Aug 24 19:40:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 19:41:49.608229 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 19:41:49.609010 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: Tue Aug 24 19:41:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 19:41:55.077564 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-edc200d6-fbd2-4276-abfb-4f68fff1a194 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:41:55.078164 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-edc200d6-fbd2-4276-abfb-4f68fff1a194 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:41:55.083877 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-edc200d6-fbd2-4276-abfb-4f68fff1a194 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:41:55.084346 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-edc200d6-fbd2-4276-abfb-4f68fff1a194 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:41:55.085106 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-edc200d6-fbd2-4276-abfb-4f68fff1a194 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:41:55.085542 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-edc200d6-fbd2-4276-abfb-4f68fff1a194 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:41:55.110253 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-edc200d6-fbd2-4276-abfb-4f68fff1a194 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Going to try to terminate instance {{(pid=108908) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:41:55.488944 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-edc200d6-fbd2-4276-abfb-4f68fff1a194 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 204 len: 0 microversion: 2.1 time: 0.416322 Aug 24 19:41:55.489579 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 622/1261] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:41:55 2021] DELETE /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:41:55.495918 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: ERROR oslo.messaging._drivers.impl_rabbit [-] [549a2371-dff1-41c9-8c68-7d128b2598e0] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 19:41:55.500030 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-07b82e56-b13b-4202-8666-0e0f8ba4e60e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:41:55.500769 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-07b82e56-b13b-4202-8666-0e0f8ba4e60e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:41:55.507369 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-07b82e56-b13b-4202-8666-0e0f8ba4e60e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:41:55.507808 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-07b82e56-b13b-4202-8666-0e0f8ba4e60e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:41:55.508590 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-07b82e56-b13b-4202-8666-0e0f8ba4e60e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:41:55.509019 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-07b82e56-b13b-4202-8666-0e0f8ba4e60e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:41:55.731522 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-07b82e56-b13b-4202-8666-0e0f8ba4e60e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:41:55.738836 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-07b82e56-b13b-4202-8666-0e0f8ba4e60e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1578 microversion: 2.1 time: 0.244828 Aug 24 19:41:55.739462 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 640/1262] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:41:55 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1578 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:41:56.755647 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-05ad0a6c-db58-482e-b557-9f3f5480cf44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:41:56.756360 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-05ad0a6c-db58-482e-b557-9f3f5480cf44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:41:56.763068 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05ad0a6c-db58-482e-b557-9f3f5480cf44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:41:56.763211 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05ad0a6c-db58-482e-b557-9f3f5480cf44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:41:56.763886 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05ad0a6c-db58-482e-b557-9f3f5480cf44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:41:56.764336 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-05ad0a6c-db58-482e-b557-9f3f5480cf44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:41:56.931804 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-05ad0a6c-db58-482e-b557-9f3f5480cf44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:41:56.940402 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-05ad0a6c-db58-482e-b557-9f3f5480cf44 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1578 microversion: 2.1 time: 0.188856 Aug 24 19:41:56.940976 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 623/1263] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:41:56 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1578 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:41:57.958187 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e5867a5e-3c4a-4e1a-ab68-e5e8865b2e7e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:41:57.958741 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e5867a5e-3c4a-4e1a-ab68-e5e8865b2e7e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:41:57.975739 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5867a5e-3c4a-4e1a-ab68-e5e8865b2e7e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:41:57.976175 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5867a5e-3c4a-4e1a-ab68-e5e8865b2e7e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:41:57.976963 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5867a5e-3c4a-4e1a-ab68-e5e8865b2e7e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:41:57.977388 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e5867a5e-3c4a-4e1a-ab68-e5e8865b2e7e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:41:57.983388 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO oslo.messaging._drivers.impl_rabbit [-] [549a2371-dff1-41c9-8c68-7d128b2598e0] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 36904. Aug 24 19:41:58.067074 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e5867a5e-3c4a-4e1a-ab68-e5e8865b2e7e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:41:58.076246 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e5867a5e-3c4a-4e1a-ab68-e5e8865b2e7e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1510 microversion: 2.1 time: 0.121697 Aug 24 19:41:58.076953 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 641/1264] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:41:57 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1510 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:41:58.331673 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-6c121324-a45f-46c0-b253-c20fe5bae047 req-2815044d-c88b-403f-89e6-77fac7958d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ee58430-380a-4eb6-8413-5259275420f4", "name": "network-vif-deleted", "tag": "277fb2fb-5c32-4b98-8d00-12815b1a5b8c"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:41:58.333483 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:41:58.333483 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:41:58.342465 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-6c121324-a45f-46c0-b253-c20fe5bae047 req-2815044d-c88b-403f-89e6-77fac7958d0a service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:41:58.342904 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-6c121324-a45f-46c0-b253-c20fe5bae047 req-2815044d-c88b-403f-89e6-77fac7958d0a service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:41:58.355738 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-6c121324-a45f-46c0-b253-c20fe5bae047 req-2815044d-c88b-403f-89e6-77fac7958d0a service nova] Creating event network-vif-deleted:277fb2fb-5c32-4b98-8d00-12815b1a5b8c for instance 6ee58430-380a-4eb6-8413-5259275420f4 on hv-cinder-79819 Aug 24 19:41:58.361717 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-6c121324-a45f-46c0-b253-c20fe5bae047 req-2815044d-c88b-403f-89e6-77fac7958d0a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102784 Aug 24 19:41:58.362401 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 624/1265] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:41:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:41:59.094068 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-41357457-3ff1-4567-823f-f11e62e74dc9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:41:59.094679 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-41357457-3ff1-4567-823f-f11e62e74dc9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:41:59.101090 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-41357457-3ff1-4567-823f-f11e62e74dc9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:41:59.101510 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-41357457-3ff1-4567-823f-f11e62e74dc9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:41:59.102308 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-41357457-3ff1-4567-823f-f11e62e74dc9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:41:59.102788 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-41357457-3ff1-4567-823f-f11e62e74dc9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:41:59.144423 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-41357457-3ff1-4567-823f-f11e62e74dc9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:41:59.144870 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-41357457-3ff1-4567-823f-f11e62e74dc9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:41:59.145323 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.objects.instance [None req-41357457-3ff1-4567-823f-f11e62e74dc9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lazy-loading 'fault' on Instance uuid 6ee58430-380a-4eb6-8413-5259275420f4 {{(pid=108907) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 24 19:41:59.184966 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-41357457-3ff1-4567-823f-f11e62e74dc9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:41:59.192429 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-41357457-3ff1-4567-823f-f11e62e74dc9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 200 len: 1231 microversion: 2.1 time: 0.102705 Aug 24 19:41:59.193052 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 642/1266] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:41:59 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 1231 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:00.209661 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-41893e91-e7c1-4488-9d5e-45f171dc2bba tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:00.210358 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-41893e91-e7c1-4488-9d5e-45f171dc2bba tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:00.217098 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-41893e91-e7c1-4488-9d5e-45f171dc2bba tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:00.217544 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-41893e91-e7c1-4488-9d5e-45f171dc2bba tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:00.218317 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-41893e91-e7c1-4488-9d5e-45f171dc2bba tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:00.218748 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-41893e91-e7c1-4488-9d5e-45f171dc2bba tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:00.232698 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-41893e91-e7c1-4488-9d5e-45f171dc2bba tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] HTTP exception thrown: Instance 6ee58430-380a-4eb6-8413-5259275420f4 could not be found. Aug 24 19:42:00.233319 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-41893e91-e7c1-4488-9d5e-45f171dc2bba tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Returning 404 to user: Instance 6ee58430-380a-4eb6-8413-5259275420f4 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:42:00.234143 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-41893e91-e7c1-4488-9d5e-45f171dc2bba tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 404 len: 111 microversion: 2.1 time: 0.028574 Aug 24 19:42:00.234681 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 625/1267] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:00 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:42:00.279823 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-104583911", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1536662292", "security_groups": [{"name": "tempest-secgroup-smoke-2064559475"}], "block_device_mapping_v2": [{"uuid": "988f836d-5f6e-4cf5-9811-2c1281e5ddc7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "91be4c16-b034-417f-ad7a-a8f3aa634a34"}]}} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:42:00.380517 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.network.neutron [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] validate_networks() for [('91be4c16-b034-417f-ad7a-a8f3aa634a34', None, None, None, None, None)] {{(pid=108907) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:42:00.797678 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Flavor limits 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:42:00.797678 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Image limits 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:42:00.797891 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Flavor pref 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:42:00.798260 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Image pref 0:0:0 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:42:00.798707 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.virt.hardware [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108907) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:42:00.809522 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:00.809968 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:00.810769 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:00.811844 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:00.828218 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Getting quotas for project e2be3a7831b54615af1b92b62f673658. Resources: {'cores', 'ram', 'instances'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:42:00.832113 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.quota [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Getting quotas for user a6000c097b514930871a9f590134104e and project e2be3a7831b54615af1b92b62f673658. Resources: {'cores', 'ram', 'instances'} {{(pid=108907) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:42:00.893935 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Going to run 1 instances... {{(pid=108907) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:42:00.896089 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='988f836d-5f6e-4cf5-9811-2c1281e5ddc7',volume_size=None,volume_type=None)] {{(pid=108907) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:42:01.306834 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-34c6c17d-a63e-48f9-8a9f-5c093567e9b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.031116 Aug 24 19:42:01.307550 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 643/1268] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:42:00 2021] POST /compute/v2.1/servers => generated 406 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 19:42:01.317755 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-29784d71-82ab-46eb-ae4a-e3d0d361b619 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:01.318370 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-29784d71-82ab-46eb-ae4a-e3d0d361b619 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:01.371522 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-29784d71-82ab-46eb-ae4a-e3d0d361b619 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:01.378983 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-29784d71-82ab-46eb-ae4a-e3d0d361b619 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1094 microversion: 2.1 time: 0.064834 Aug 24 19:42:01.380037 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 626/1269] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:01 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:02.397029 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-973963cc-03d0-44ec-b650-70d0a6a4edc1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:02.397582 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-973963cc-03d0-44ec-b650-70d0a6a4edc1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:02.450915 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-973963cc-03d0-44ec-b650-70d0a6a4edc1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:02.458240 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-973963cc-03d0-44ec-b650-70d0a6a4edc1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1094 microversion: 2.1 time: 0.065004 Aug 24 19:42:02.458796 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 644/1270] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:02 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:03.474760 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-460a2178-f77d-4ae0-8144-c0fa0f38b944 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:03.475436 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-460a2178-f77d-4ae0-8144-c0fa0f38b944 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:03.481478 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-460a2178-f77d-4ae0-8144-c0fa0f38b944 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:03.481949 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-460a2178-f77d-4ae0-8144-c0fa0f38b944 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:03.482701 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-460a2178-f77d-4ae0-8144-c0fa0f38b944 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:03.483126 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-460a2178-f77d-4ae0-8144-c0fa0f38b944 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:03.543039 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-460a2178-f77d-4ae0-8144-c0fa0f38b944 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:03.550344 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-460a2178-f77d-4ae0-8144-c0fa0f38b944 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1192 microversion: 2.1 time: 0.079322 Aug 24 19:42:03.550894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 627/1271] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:03 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1192 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:04.566980 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8bb72bcd-ec6a-45ef-a375-5b4c84b1fc57 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:04.567680 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8bb72bcd-ec6a-45ef-a375-5b4c84b1fc57 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:04.574913 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8bb72bcd-ec6a-45ef-a375-5b4c84b1fc57 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:04.575567 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8bb72bcd-ec6a-45ef-a375-5b4c84b1fc57 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:04.576371 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8bb72bcd-ec6a-45ef-a375-5b4c84b1fc57 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:04.576797 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8bb72bcd-ec6a-45ef-a375-5b4c84b1fc57 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:04.702606 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8bb72bcd-ec6a-45ef-a375-5b4c84b1fc57 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:04.710444 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8bb72bcd-ec6a-45ef-a375-5b4c84b1fc57 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1278 microversion: 2.1 time: 0.147283 Aug 24 19:42:04.711090 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 645/1272] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:04 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:05.647657 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-0e6fc516-d8fb-4962-aba2-8ae75c25164e req-754bfc8e-1316-4141-b35c-7a5d3cca03ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f21a777-aa5d-4b69-b2dc-fff666007e06", "tag": "e8596897-e25d-45a8-9e90-a10e29373fa7"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:42:05.654173 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:42:05.654173 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:42:05.674887 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-0e6fc516-d8fb-4962-aba2-8ae75c25164e req-754bfc8e-1316-4141-b35c-7a5d3cca03ec service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:05.676307 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-0e6fc516-d8fb-4962-aba2-8ae75c25164e req-754bfc8e-1316-4141-b35c-7a5d3cca03ec service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:05.688421 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-0e6fc516-d8fb-4962-aba2-8ae75c25164e req-754bfc8e-1316-4141-b35c-7a5d3cca03ec service nova] Creating event network-changed:e8596897-e25d-45a8-9e90-a10e29373fa7 for instance 5f21a777-aa5d-4b69-b2dc-fff666007e06 on hv-cinder-79819 Aug 24 19:42:05.693623 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-0e6fc516-d8fb-4962-aba2-8ae75c25164e req-754bfc8e-1316-4141-b35c-7a5d3cca03ec service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049640 Aug 24 19:42:05.694225 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 628/1273] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:42:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:42:05.727997 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-24b47e5d-59d6-4f5c-90ef-ef24257276df tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:05.728642 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-24b47e5d-59d6-4f5c-90ef-ef24257276df tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:05.736545 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-24b47e5d-59d6-4f5c-90ef-ef24257276df tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:05.737276 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-24b47e5d-59d6-4f5c-90ef-ef24257276df tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:05.738706 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-24b47e5d-59d6-4f5c-90ef-ef24257276df tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:05.739154 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-24b47e5d-59d6-4f5c-90ef-ef24257276df tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:05.947757 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-24b47e5d-59d6-4f5c-90ef-ef24257276df tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:05.956179 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-24b47e5d-59d6-4f5c-90ef-ef24257276df tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1266 microversion: 2.1 time: 0.231819 Aug 24 19:42:05.956798 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 646/1274] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:05 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:06.973639 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e656ee15-2760-4d87-91b4-c0c4e6d331fe tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:06.974364 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e656ee15-2760-4d87-91b4-c0c4e6d331fe tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:06.980549 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e656ee15-2760-4d87-91b4-c0c4e6d331fe tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:06.980998 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e656ee15-2760-4d87-91b4-c0c4e6d331fe tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:06.981756 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e656ee15-2760-4d87-91b4-c0c4e6d331fe tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:06.982189 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e656ee15-2760-4d87-91b4-c0c4e6d331fe tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:07.100921 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e656ee15-2760-4d87-91b4-c0c4e6d331fe tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:07.108276 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e656ee15-2760-4d87-91b4-c0c4e6d331fe tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1266 microversion: 2.1 time: 0.138625 Aug 24 19:42:07.108860 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 629/1275] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:06 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:42:08.125455 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-86133fd0-73c2-44d2-9116-830f8b431b33 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:08.126039 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-86133fd0-73c2-44d2-9116-830f8b431b33 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:08.132003 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-86133fd0-73c2-44d2-9116-830f8b431b33 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:08.132469 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-86133fd0-73c2-44d2-9116-830f8b431b33 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:08.133218 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-86133fd0-73c2-44d2-9116-830f8b431b33 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:08.133640 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-86133fd0-73c2-44d2-9116-830f8b431b33 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:08.254458 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-86133fd0-73c2-44d2-9116-830f8b431b33 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:08.261794 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-86133fd0-73c2-44d2-9116-830f8b431b33 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1266 microversion: 2.1 time: 0.140021 Aug 24 19:42:08.262357 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 647/1276] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:08 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:09.279168 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-20f6187f-c664-4e64-a2a7-eb96f2ed4f56 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:09.279810 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-20f6187f-c664-4e64-a2a7-eb96f2ed4f56 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:09.286313 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-20f6187f-c664-4e64-a2a7-eb96f2ed4f56 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:09.286761 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-20f6187f-c664-4e64-a2a7-eb96f2ed4f56 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:09.287522 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-20f6187f-c664-4e64-a2a7-eb96f2ed4f56 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:09.287953 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-20f6187f-c664-4e64-a2a7-eb96f2ed4f56 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:09.404342 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-20f6187f-c664-4e64-a2a7-eb96f2ed4f56 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:09.411572 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-20f6187f-c664-4e64-a2a7-eb96f2ed4f56 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1266 microversion: 2.1 time: 0.136148 Aug 24 19:42:09.412140 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 630/1277] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:09 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:10.428286 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-20f3303b-18f6-4893-a1eb-bcb31ceb75c6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:10.428926 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-20f3303b-18f6-4893-a1eb-bcb31ceb75c6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:10.434830 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-20f3303b-18f6-4893-a1eb-bcb31ceb75c6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:10.435280 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-20f3303b-18f6-4893-a1eb-bcb31ceb75c6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:10.436086 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-20f3303b-18f6-4893-a1eb-bcb31ceb75c6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:10.436628 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-20f3303b-18f6-4893-a1eb-bcb31ceb75c6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:10.557157 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-20f3303b-18f6-4893-a1eb-bcb31ceb75c6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:10.564801 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-20f3303b-18f6-4893-a1eb-bcb31ceb75c6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1266 microversion: 2.1 time: 0.140325 Aug 24 19:42:10.565356 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 648/1278] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:10 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:11.581527 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-71719db4-bbc3-4d1c-8343-2510cae5a0f8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:11.582110 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-71719db4-bbc3-4d1c-8343-2510cae5a0f8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:11.588032 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-71719db4-bbc3-4d1c-8343-2510cae5a0f8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:11.588510 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-71719db4-bbc3-4d1c-8343-2510cae5a0f8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:11.589261 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-71719db4-bbc3-4d1c-8343-2510cae5a0f8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:11.589739 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-71719db4-bbc3-4d1c-8343-2510cae5a0f8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:11.709516 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-71719db4-bbc3-4d1c-8343-2510cae5a0f8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:11.716783 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-71719db4-bbc3-4d1c-8343-2510cae5a0f8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1266 microversion: 2.1 time: 0.139511 Aug 24 19:42:11.717342 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 631/1279] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:11 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1266 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:12.733362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-618ec7f7-8718-4833-8aef-9c0ad8d9d3f7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:12.736408 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-618ec7f7-8718-4833-8aef-9c0ad8d9d3f7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:12.740715 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-618ec7f7-8718-4833-8aef-9c0ad8d9d3f7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:12.741158 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-618ec7f7-8718-4833-8aef-9c0ad8d9d3f7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:12.741905 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-618ec7f7-8718-4833-8aef-9c0ad8d9d3f7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:12.742327 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-618ec7f7-8718-4833-8aef-9c0ad8d9d3f7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:12.860400 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-618ec7f7-8718-4833-8aef-9c0ad8d9d3f7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:12.868512 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-618ec7f7-8718-4833-8aef-9c0ad8d9d3f7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1266 microversion: 2.1 time: 0.138835 Aug 24 19:42:12.869079 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 649/1280] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:12 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:13.885285 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-c4f2e8e4-a48f-47e0-9ff1-3282acd77722 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:13.885889 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-c4f2e8e4-a48f-47e0-9ff1-3282acd77722 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:13.891913 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c4f2e8e4-a48f-47e0-9ff1-3282acd77722 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:13.892387 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c4f2e8e4-a48f-47e0-9ff1-3282acd77722 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:13.893148 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c4f2e8e4-a48f-47e0-9ff1-3282acd77722 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:13.893578 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-c4f2e8e4-a48f-47e0-9ff1-3282acd77722 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:14.010920 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-c4f2e8e4-a48f-47e0-9ff1-3282acd77722 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:14.018025 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-c4f2e8e4-a48f-47e0-9ff1-3282acd77722 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1266 microversion: 2.1 time: 0.136458 Aug 24 19:42:14.018580 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 632/1281] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:13 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:15.034818 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c81c6bc0-60c2-419e-bece-998d08ed9c3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:15.035422 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c81c6bc0-60c2-419e-bece-998d08ed9c3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:15.041257 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c81c6bc0-60c2-419e-bece-998d08ed9c3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:15.041730 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c81c6bc0-60c2-419e-bece-998d08ed9c3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:15.042522 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c81c6bc0-60c2-419e-bece-998d08ed9c3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:15.042947 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c81c6bc0-60c2-419e-bece-998d08ed9c3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:15.164223 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c81c6bc0-60c2-419e-bece-998d08ed9c3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:15.172728 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c81c6bc0-60c2-419e-bece-998d08ed9c3c tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1266 microversion: 2.1 time: 0.140782 Aug 24 19:42:15.173306 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 650/1282] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:15 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:16.189695 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-06ed70a6-9b65-45c4-ba9b-bd76dd2391b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:16.190235 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-06ed70a6-9b65-45c4-ba9b-bd76dd2391b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:16.196753 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-06ed70a6-9b65-45c4-ba9b-bd76dd2391b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:16.197206 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-06ed70a6-9b65-45c4-ba9b-bd76dd2391b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:16.198075 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-06ed70a6-9b65-45c4-ba9b-bd76dd2391b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:16.198514 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-06ed70a6-9b65-45c4-ba9b-bd76dd2391b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:16.324370 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-06ed70a6-9b65-45c4-ba9b-bd76dd2391b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:16.331761 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-06ed70a6-9b65-45c4-ba9b-bd76dd2391b8 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1266 microversion: 2.1 time: 0.145887 Aug 24 19:42:16.332335 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 633/1283] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:16 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:16.546346 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-c2ec83bd-da59-4e43-ae20-5d4ca575f9d3 req-03bd8c73-b5dd-4eb0-adf6-88dc31d9a515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f21a777-aa5d-4b69-b2dc-fff666007e06", "name": "network-vif-plugged", "status": "completed", "tag": "e8596897-e25d-45a8-9e90-a10e29373fa7"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:42:16.547924 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:42:16.547924 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:42:16.555291 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-c2ec83bd-da59-4e43-ae20-5d4ca575f9d3 req-03bd8c73-b5dd-4eb0-adf6-88dc31d9a515 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:16.555725 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-c2ec83bd-da59-4e43-ae20-5d4ca575f9d3 req-03bd8c73-b5dd-4eb0-adf6-88dc31d9a515 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:16.566745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-c2ec83bd-da59-4e43-ae20-5d4ca575f9d3 req-03bd8c73-b5dd-4eb0-adf6-88dc31d9a515 service nova] Creating event network-vif-plugged:e8596897-e25d-45a8-9e90-a10e29373fa7 for instance 5f21a777-aa5d-4b69-b2dc-fff666007e06 on hv-cinder-79819 Aug 24 19:42:16.571846 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-c2ec83bd-da59-4e43-ae20-5d4ca575f9d3 req-03bd8c73-b5dd-4eb0-adf6-88dc31d9a515 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090276 Aug 24 19:42:16.572386 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 651/1284] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:42:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:42:17.347372 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-512a0057-3c89-4607-9e14-6f44481417e7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:17.347986 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-512a0057-3c89-4607-9e14-6f44481417e7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:17.353830 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-512a0057-3c89-4607-9e14-6f44481417e7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:17.354279 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-512a0057-3c89-4607-9e14-6f44481417e7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:17.355069 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-512a0057-3c89-4607-9e14-6f44481417e7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:17.355500 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-512a0057-3c89-4607-9e14-6f44481417e7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:17.482793 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-512a0057-3c89-4607-9e14-6f44481417e7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:17.490018 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-512a0057-3c89-4607-9e14-6f44481417e7 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1266 microversion: 2.1 time: 0.146349 Aug 24 19:42:17.490862 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 634/1285] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:17 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:18.507838 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-538d16da-cdff-4280-943b-35d74e79953e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:18.508557 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-538d16da-cdff-4280-943b-35d74e79953e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:18.514731 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-538d16da-cdff-4280-943b-35d74e79953e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:18.515173 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-538d16da-cdff-4280-943b-35d74e79953e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:18.515925 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-538d16da-cdff-4280-943b-35d74e79953e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:18.516379 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-538d16da-cdff-4280-943b-35d74e79953e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:18.633461 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-538d16da-cdff-4280-943b-35d74e79953e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:18.640818 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-538d16da-cdff-4280-943b-35d74e79953e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1452 microversion: 2.1 time: 0.137097 Aug 24 19:42:18.641384 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 652/1286] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:18 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1452 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:18.657114 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-aaa156db-171d-4a53-bdd4-ba7d3c73d2f2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:42:18.657805 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-aaa156db-171d-4a53-bdd4-ba7d3c73d2f2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:42:18.664376 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aaa156db-171d-4a53-bdd4-ba7d3c73d2f2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:18.664831 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aaa156db-171d-4a53-bdd4-ba7d3c73d2f2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:18.665606 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aaa156db-171d-4a53-bdd4-ba7d3c73d2f2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:18.666039 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-aaa156db-171d-4a53-bdd4-ba7d3c73d2f2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:18.781738 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-aaa156db-171d-4a53-bdd4-ba7d3c73d2f2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:42:18.789077 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-aaa156db-171d-4a53-bdd4-ba7d3c73d2f2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1452 microversion: 2.1 time: 0.135695 Aug 24 19:42:18.789666 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 635/1287] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:42:18 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:42:20.906544 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-d3cc638e-f3e1-4b03-816d-99b2f9c51aca req-29694911-e745-47ae-9b57-cfafdcce63b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f21a777-aa5d-4b69-b2dc-fff666007e06", "tag": "e8596897-e25d-45a8-9e90-a10e29373fa7"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:42:20.907148 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:42:20.907148 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:42:20.914791 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-d3cc638e-f3e1-4b03-816d-99b2f9c51aca req-29694911-e745-47ae-9b57-cfafdcce63b3 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:42:20.916357 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-d3cc638e-f3e1-4b03-816d-99b2f9c51aca req-29694911-e745-47ae-9b57-cfafdcce63b3 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:42:20.926257 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-d3cc638e-f3e1-4b03-816d-99b2f9c51aca req-29694911-e745-47ae-9b57-cfafdcce63b3 service nova] Creating event network-changed:e8596897-e25d-45a8-9e90-a10e29373fa7 for instance 5f21a777-aa5d-4b69-b2dc-fff666007e06 on hv-cinder-79819 Aug 24 19:42:20.931954 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-d3cc638e-f3e1-4b03-816d-99b2f9c51aca req-29694911-e745-47ae-9b57-cfafdcce63b3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030646 Aug 24 19:42:20.932578 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 653/1288] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:42:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:44:08.025014 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f64552f4-747f-4922-ba77-da26c94d1fc1] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 19:44:08.028788 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1927986856", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1536662292", "security_groups": [{"name": "tempest-secgroup-smoke-2064559475"}], "block_device_mapping_v2": [{"uuid": "928fe5f0-bdf1-4d6a-b766-d659f298de3d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "91be4c16-b034-417f-ad7a-a8f3aa634a34"}]}} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:44:08.129750 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.network.neutron [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] validate_networks() for [('91be4c16-b034-417f-ad7a-a8f3aa634a34', None, None, None, None, None)] {{(pid=108908) validate_networks /opt/stack/nova/nova/network/neutron.py:2309}} Aug 24 19:44:08.566269 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Flavor limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 19:44:08.566695 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Image limits 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 19:44:08.567172 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Flavor pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 19:44:08.567580 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Image pref 0:0:0 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 19:44:08.567999 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.virt.hardware [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108908) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 19:44:08.577578 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:08.578033 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:08.578831 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:08.579265 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:08.596006 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Getting quotas for project e2be3a7831b54615af1b92b62f673658. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 24 19:44:08.599964 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.quota [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Getting quotas for user a6000c097b514930871a9f590134104e and project e2be3a7831b54615af1b92b62f673658. Resources: {'cores', 'ram', 'instances'} {{(pid=108908) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 24 19:44:08.659560 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Going to run 1 instances... {{(pid=108908) _provision_instances /opt/stack/nova/nova/compute/api.py:1314}} Aug 24 19:44:08.661832 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='928fe5f0-bdf1-4d6a-b766-d659f298de3d',volume_size=None,volume_type=None)] {{(pid=108908) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1719}} Aug 24 19:44:09.042286 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO oslo.messaging._drivers.impl_rabbit [-] [f64552f4-747f-4922-ba77-da26c94d1fc1] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 37072. Aug 24 19:44:09.074671 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [83cb3ec2-9e43-4408-800c-cb35712b063b] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 19:44:10.091654 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO oslo.messaging._drivers.impl_rabbit [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [83cb3ec2-9e43-4408-800c-cb35712b063b] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 37074. Aug 24 19:44:10.095831 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-2a016e9a-eb50-43be-85fe-993daec89de3 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.072593 Aug 24 19:44:10.097011 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 636/1289] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Aug 24 19:44:08 2021] POST /compute/v2.1/servers => generated 406 bytes in 2074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 19:44:10.105174 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: ERROR oslo.messaging._drivers.impl_rabbit [-] [549a2371-dff1-41c9-8c68-7d128b2598e0] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 24 19:44:10.109339 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-169282ee-6608-49a5-b49a-94eb33cba93e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:10.110027 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-169282ee-6608-49a5-b49a-94eb33cba93e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:10.161708 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-169282ee-6608-49a5-b49a-94eb33cba93e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:10.168079 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-169282ee-6608-49a5-b49a-94eb33cba93e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1095 microversion: 2.1 time: 0.064982 Aug 24 19:44:10.168748 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 654/1290] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:10 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:11.185006 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-a8a25944-4a24-4f83-9947-5de176199fc1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:11.185614 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-a8a25944-4a24-4f83-9947-5de176199fc1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:11.235111 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-a8a25944-4a24-4f83-9947-5de176199fc1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:11.242265 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-a8a25944-4a24-4f83-9947-5de176199fc1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1095 microversion: 2.1 time: 0.061132 Aug 24 19:44:11.242823 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 637/1291] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:11 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1095 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:12.258947 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-5aca4690-535b-4fc2-914b-9f4c960374f5 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:12.259710 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-5aca4690-535b-4fc2-914b-9f4c960374f5 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:12.297008 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO oslo.messaging._drivers.impl_rabbit [-] [549a2371-dff1-41c9-8c68-7d128b2598e0] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 37094. Aug 24 19:44:12.325638 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-5aca4690-535b-4fc2-914b-9f4c960374f5 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:12.332709 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-5aca4690-535b-4fc2-914b-9f4c960374f5 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1095 microversion: 2.1 time: 0.077345 Aug 24 19:44:12.333263 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 655/1292] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:12 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:13.349728 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d9357224-1208-41f5-8c2c-131721d736b6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:13.350342 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d9357224-1208-41f5-8c2c-131721d736b6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:13.402333 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d9357224-1208-41f5-8c2c-131721d736b6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:13.410747 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d9357224-1208-41f5-8c2c-131721d736b6 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1095 microversion: 2.1 time: 0.065337 Aug 24 19:44:13.411298 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 638/1293] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:13 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:14.427363 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-402d1559-4445-401b-9cce-7fef98bfc2e9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:14.427993 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-402d1559-4445-401b-9cce-7fef98bfc2e9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:14.434212 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-402d1559-4445-401b-9cce-7fef98bfc2e9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:14.434650 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-402d1559-4445-401b-9cce-7fef98bfc2e9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:14.435400 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-402d1559-4445-401b-9cce-7fef98bfc2e9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:14.435821 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-402d1559-4445-401b-9cce-7fef98bfc2e9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:14.493362 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-402d1559-4445-401b-9cce-7fef98bfc2e9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:14.500475 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-402d1559-4445-401b-9cce-7fef98bfc2e9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1145 microversion: 2.1 time: 0.077346 Aug 24 19:44:14.501026 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 656/1294] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:14 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1145 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:15.587188 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-d2561075-572a-4e28-b0e6-4855669a30ff tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:15.587916 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-d2561075-572a-4e28-b0e6-4855669a30ff tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:15.594376 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d2561075-572a-4e28-b0e6-4855669a30ff tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:15.594761 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d2561075-572a-4e28-b0e6-4855669a30ff tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:15.595568 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d2561075-572a-4e28-b0e6-4855669a30ff tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:15.595996 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-d2561075-572a-4e28-b0e6-4855669a30ff tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:15.657271 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-d2561075-572a-4e28-b0e6-4855669a30ff tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:15.665641 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-d2561075-572a-4e28-b0e6-4855669a30ff tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1193 microversion: 2.1 time: 0.152016 Aug 24 19:44:15.666200 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 639/1295] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:15 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1193 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:44:16.682874 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-f8a64f06-a68c-478e-b843-a299a6ad6f0e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:16.683435 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-f8a64f06-a68c-478e-b843-a299a6ad6f0e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:16.689059 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f8a64f06-a68c-478e-b843-a299a6ad6f0e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:16.690001 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f8a64f06-a68c-478e-b843-a299a6ad6f0e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:16.690765 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f8a64f06-a68c-478e-b843-a299a6ad6f0e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:16.691236 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-f8a64f06-a68c-478e-b843-a299a6ad6f0e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:16.757895 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-f8a64f06-a68c-478e-b843-a299a6ad6f0e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:16.765135 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-f8a64f06-a68c-478e-b843-a299a6ad6f0e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1211 microversion: 2.1 time: 0.086042 Aug 24 19:44:16.765690 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 657/1296] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:16 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:17.782495 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f28b5e90-390e-416f-affa-0b0bb06349f1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:17.783699 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f28b5e90-390e-416f-affa-0b0bb06349f1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:17.789669 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f28b5e90-390e-416f-affa-0b0bb06349f1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:17.791385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f28b5e90-390e-416f-affa-0b0bb06349f1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:17.791385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f28b5e90-390e-416f-affa-0b0bb06349f1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:17.791385 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f28b5e90-390e-416f-affa-0b0bb06349f1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:17.895551 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [req-11938928-d534-41e5-b0be-0307ed85646a req-8aede852-aa91-4a0c-86d0-983fdb4f5051 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced7d1cd-bf5b-49de-8b65-c2f4920242dc", "tag": "575120ce-b83d-4789-a305-68f33b5089bd"}]} {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:44:17.897219 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:44:17.897219 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: warnings.warn(msg) Aug 24 19:44:17.908802 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-11938928-d534-41e5-b0be-0307ed85646a req-8aede852-aa91-4a0c-86d0-983fdb4f5051 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:17.908802 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [req-11938928-d534-41e5-b0be-0307ed85646a req-8aede852-aa91-4a0c-86d0-983fdb4f5051 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:17.919141 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.compute.server_external_events [req-11938928-d534-41e5-b0be-0307ed85646a req-8aede852-aa91-4a0c-86d0-983fdb4f5051 service nova] Creating event network-changed:575120ce-b83d-4789-a305-68f33b5089bd for instance ced7d1cd-bf5b-49de-8b65-c2f4920242dc on hv-cinder-79819 Aug 24 19:44:17.925384 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [req-11938928-d534-41e5-b0be-0307ed85646a req-8aede852-aa91-4a0c-86d0-983fdb4f5051 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036131 Aug 24 19:44:17.926340 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 658/1297] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:44:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:44:18.006536 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f28b5e90-390e-416f-affa-0b0bb06349f1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:18.024293 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f28b5e90-390e-416f-affa-0b0bb06349f1 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1267 microversion: 2.1 time: 0.245320 Aug 24 19:44:18.024894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 640/1298] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:17 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1267 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:19.042355 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e945882e-94ac-4ee2-83a0-803b5ba0d604 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:19.043045 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e945882e-94ac-4ee2-83a0-803b5ba0d604 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:19.049110 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e945882e-94ac-4ee2-83a0-803b5ba0d604 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:19.049556 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e945882e-94ac-4ee2-83a0-803b5ba0d604 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:19.050316 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e945882e-94ac-4ee2-83a0-803b5ba0d604 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:19.050748 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e945882e-94ac-4ee2-83a0-803b5ba0d604 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:19.168184 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e945882e-94ac-4ee2-83a0-803b5ba0d604 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:19.175593 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e945882e-94ac-4ee2-83a0-803b5ba0d604 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1267 microversion: 2.1 time: 0.137313 Aug 24 19:44:19.176151 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 659/1299] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:19 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:20.192112 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-f279583b-02ad-4830-812a-389b2dfc73b2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:20.192726 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-f279583b-02ad-4830-812a-389b2dfc73b2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:20.198530 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f279583b-02ad-4830-812a-389b2dfc73b2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:20.198999 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f279583b-02ad-4830-812a-389b2dfc73b2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:20.199753 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f279583b-02ad-4830-812a-389b2dfc73b2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:20.200178 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-f279583b-02ad-4830-812a-389b2dfc73b2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:20.326147 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-f279583b-02ad-4830-812a-389b2dfc73b2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:20.333930 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-f279583b-02ad-4830-812a-389b2dfc73b2 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1267 microversion: 2.1 time: 0.145573 Aug 24 19:44:20.334486 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 641/1300] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:20 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:21.349942 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a5a3f924-0c24-4991-ad9c-0662d3cb980f tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:21.350547 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a5a3f924-0c24-4991-ad9c-0662d3cb980f tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:21.356620 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a5a3f924-0c24-4991-ad9c-0662d3cb980f tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:21.357066 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a5a3f924-0c24-4991-ad9c-0662d3cb980f tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:21.357862 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a5a3f924-0c24-4991-ad9c-0662d3cb980f tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:21.358294 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a5a3f924-0c24-4991-ad9c-0662d3cb980f tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:21.479696 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a5a3f924-0c24-4991-ad9c-0662d3cb980f tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:21.487407 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a5a3f924-0c24-4991-ad9c-0662d3cb980f tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1267 microversion: 2.1 time: 0.141243 Aug 24 19:44:21.487977 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 660/1301] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:21 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:22.503991 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-e77a3cb9-d7ee-4180-ab8a-75381f8485d4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:22.504619 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-e77a3cb9-d7ee-4180-ab8a-75381f8485d4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:22.510571 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e77a3cb9-d7ee-4180-ab8a-75381f8485d4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:22.511038 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e77a3cb9-d7ee-4180-ab8a-75381f8485d4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:22.511795 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e77a3cb9-d7ee-4180-ab8a-75381f8485d4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:22.512224 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-e77a3cb9-d7ee-4180-ab8a-75381f8485d4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:22.628342 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-e77a3cb9-d7ee-4180-ab8a-75381f8485d4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:22.635459 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-e77a3cb9-d7ee-4180-ab8a-75381f8485d4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1267 microversion: 2.1 time: 0.135146 Aug 24 19:44:22.636013 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 642/1302] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:22 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1267 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:23.652597 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-c877767d-1510-471c-bf12-0eee43939820 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:23.653195 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-c877767d-1510-471c-bf12-0eee43939820 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:23.659530 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c877767d-1510-471c-bf12-0eee43939820 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:23.659965 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c877767d-1510-471c-bf12-0eee43939820 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:23.660740 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c877767d-1510-471c-bf12-0eee43939820 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:23.661164 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-c877767d-1510-471c-bf12-0eee43939820 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:23.779065 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-c877767d-1510-471c-bf12-0eee43939820 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:23.786726 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-c877767d-1510-471c-bf12-0eee43939820 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1267 microversion: 2.1 time: 0.137764 Aug 24 19:44:23.787287 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 661/1303] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:23 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:24.803394 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-989bd695-d78b-4d21-ab21-ec3213fa8a58 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:24.803995 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-989bd695-d78b-4d21-ab21-ec3213fa8a58 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:24.809971 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-989bd695-d78b-4d21-ab21-ec3213fa8a58 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:24.810406 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-989bd695-d78b-4d21-ab21-ec3213fa8a58 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:24.811215 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-989bd695-d78b-4d21-ab21-ec3213fa8a58 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:24.812328 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-989bd695-d78b-4d21-ab21-ec3213fa8a58 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:24.928936 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-989bd695-d78b-4d21-ab21-ec3213fa8a58 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:24.936058 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-989bd695-d78b-4d21-ab21-ec3213fa8a58 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1267 microversion: 2.1 time: 0.136505 Aug 24 19:44:24.936648 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 643/1304] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:24 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:25.953248 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-e0b3a1c7-392e-4c2d-b1a3-237731258588 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:25.953877 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-e0b3a1c7-392e-4c2d-b1a3-237731258588 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:25.959812 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e0b3a1c7-392e-4c2d-b1a3-237731258588 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:25.960248 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e0b3a1c7-392e-4c2d-b1a3-237731258588 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:25.961026 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e0b3a1c7-392e-4c2d-b1a3-237731258588 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:25.961474 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-e0b3a1c7-392e-4c2d-b1a3-237731258588 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:26.077174 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-e0b3a1c7-392e-4c2d-b1a3-237731258588 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:26.084236 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-e0b3a1c7-392e-4c2d-b1a3-237731258588 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1267 microversion: 2.1 time: 0.135550 Aug 24 19:44:26.084816 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 662/1305] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:25 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:27.101445 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-ab6bb873-0a98-4736-aed4-33f43d32790e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:27.101973 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-ab6bb873-0a98-4736-aed4-33f43d32790e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:27.107785 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ab6bb873-0a98-4736-aed4-33f43d32790e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:27.108234 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ab6bb873-0a98-4736-aed4-33f43d32790e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:27.109049 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ab6bb873-0a98-4736-aed4-33f43d32790e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:27.109477 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-ab6bb873-0a98-4736-aed4-33f43d32790e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:27.229466 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-ab6bb873-0a98-4736-aed4-33f43d32790e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:27.236751 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-ab6bb873-0a98-4736-aed4-33f43d32790e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1267 microversion: 2.1 time: 0.139231 Aug 24 19:44:27.237370 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 644/1306] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:27 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:28.253095 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8a62d4a0-6f0d-4120-a8f3-f5ade88e5907 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:28.253692 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8a62d4a0-6f0d-4120-a8f3-f5ade88e5907 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:28.259615 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8a62d4a0-6f0d-4120-a8f3-f5ade88e5907 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:28.260051 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8a62d4a0-6f0d-4120-a8f3-f5ade88e5907 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:28.260876 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8a62d4a0-6f0d-4120-a8f3-f5ade88e5907 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:28.261293 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8a62d4a0-6f0d-4120-a8f3-f5ade88e5907 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:28.720841 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-8a62d4a0-6f0d-4120-a8f3-f5ade88e5907 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:28.728477 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8a62d4a0-6f0d-4120-a8f3-f5ade88e5907 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1267 microversion: 2.1 time: 0.478958 Aug 24 19:44:28.729365 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 663/1307] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:28 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1267 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:44:28.806145 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 19:44:28.806686 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: Tue Aug 24 19:44:28 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 19:44:29.122333 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-219897cf-c698-4adf-bf6e-cf4dda75f7e0 req-cad8211d-0779-4ab5-ae26-5963947c8799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced7d1cd-bf5b-49de-8b65-c2f4920242dc", "name": "network-vif-plugged", "status": "completed", "tag": "575120ce-b83d-4789-a305-68f33b5089bd"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:44:29.123884 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:44:29.123884 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:44:29.131249 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-219897cf-c698-4adf-bf6e-cf4dda75f7e0 req-cad8211d-0779-4ab5-ae26-5963947c8799 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:29.131684 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-219897cf-c698-4adf-bf6e-cf4dda75f7e0 req-cad8211d-0779-4ab5-ae26-5963947c8799 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:29.142855 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-219897cf-c698-4adf-bf6e-cf4dda75f7e0 req-cad8211d-0779-4ab5-ae26-5963947c8799 service nova] Creating event network-vif-plugged:575120ce-b83d-4789-a305-68f33b5089bd for instance ced7d1cd-bf5b-49de-8b65-c2f4920242dc on hv-cinder-79819 Aug 24 19:44:29.148160 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-219897cf-c698-4adf-bf6e-cf4dda75f7e0 req-cad8211d-0779-4ab5-ae26-5963947c8799 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029574 Aug 24 19:44:29.148734 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 645/1308] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:44:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:44:29.744437 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-ae617b10-9b24-442d-8309-615986ec2c9d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:29.745117 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-ae617b10-9b24-442d-8309-615986ec2c9d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:29.751055 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ae617b10-9b24-442d-8309-615986ec2c9d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:29.751491 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ae617b10-9b24-442d-8309-615986ec2c9d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:29.752240 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ae617b10-9b24-442d-8309-615986ec2c9d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:29.752686 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-ae617b10-9b24-442d-8309-615986ec2c9d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:29.870949 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-ae617b10-9b24-442d-8309-615986ec2c9d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:29.878258 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-ae617b10-9b24-442d-8309-615986ec2c9d tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1267 microversion: 2.1 time: 0.137424 Aug 24 19:44:29.878818 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 664/1309] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:29 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:30.896388 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-6f19748b-5861-4025-8d21-85b27706f307 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:30.897084 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-6f19748b-5861-4025-8d21-85b27706f307 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:30.903252 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6f19748b-5861-4025-8d21-85b27706f307 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:30.903698 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6f19748b-5861-4025-8d21-85b27706f307 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:30.904506 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6f19748b-5861-4025-8d21-85b27706f307 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:30.904957 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-6f19748b-5861-4025-8d21-85b27706f307 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:31.023564 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-6f19748b-5861-4025-8d21-85b27706f307 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:31.030894 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-6f19748b-5861-4025-8d21-85b27706f307 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1454 microversion: 2.1 time: 0.139257 Aug 24 19:44:31.031446 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 646/1310] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:30 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1454 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:31.046917 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-a164531a-12ef-4a88-b9c9-abef28f5271e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:44:31.047557 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-a164531a-12ef-4a88-b9c9-abef28f5271e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:44:31.053398 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a164531a-12ef-4a88-b9c9-abef28f5271e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:31.053839 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a164531a-12ef-4a88-b9c9-abef28f5271e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:31.054593 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a164531a-12ef-4a88-b9c9-abef28f5271e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:31.055070 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-a164531a-12ef-4a88-b9c9-abef28f5271e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:31.172087 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-a164531a-12ef-4a88-b9c9-abef28f5271e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:44:31.179352 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-a164531a-12ef-4a88-b9c9-abef28f5271e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1454 microversion: 2.1 time: 0.136081 Aug 24 19:44:31.179910 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 665/1311] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:44:31 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1454 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:44:33.125070 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-aadc3ae7-3f18-4ad9-ab8e-224b471a55f8 req-6a25ce40-c945-48ab-8968-bb6964f6aecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced7d1cd-bf5b-49de-8b65-c2f4920242dc", "tag": "575120ce-b83d-4789-a305-68f33b5089bd"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:44:33.127089 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:44:33.127089 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:44:33.133986 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-aadc3ae7-3f18-4ad9-ab8e-224b471a55f8 req-6a25ce40-c945-48ab-8968-bb6964f6aecb service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:44:33.138448 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-aadc3ae7-3f18-4ad9-ab8e-224b471a55f8 req-6a25ce40-c945-48ab-8968-bb6964f6aecb service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:44:33.145464 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-aadc3ae7-3f18-4ad9-ab8e-224b471a55f8 req-6a25ce40-c945-48ab-8968-bb6964f6aecb service nova] Creating event network-changed:575120ce-b83d-4789-a305-68f33b5089bd for instance ced7d1cd-bf5b-49de-8b65-c2f4920242dc on hv-cinder-79819 Aug 24 19:44:33.151103 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-aadc3ae7-3f18-4ad9-ab8e-224b471a55f8 req-6a25ce40-c945-48ab-8968-bb6964f6aecb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029409 Aug 24 19:44:33.151783 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 647/1312] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:44:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:45:06.293540 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 19:45:06.294162 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: Tue Aug 24 19:45:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 19:45:09.625539 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 19:45:09.626211 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: Tue Aug 24 19:45:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 19:46:12.779031 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-b065af5a-f147-4b21-877d-57ada2a7d801 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:46:12.779726 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b065af5a-f147-4b21-877d-57ada2a7d801 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:46:12.784719 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-5cd96d62-9a2f-4d21-9f6f-98395effd25d req-751d3f58-9e61-4cd7-8e53-9a159fbe13a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced7d1cd-bf5b-49de-8b65-c2f4920242dc", "tag": "575120ce-b83d-4789-a305-68f33b5089bd"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:46:12.786733 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:46:12.786733 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:46:12.787820 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b065af5a-f147-4b21-877d-57ada2a7d801 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:12.788373 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b065af5a-f147-4b21-877d-57ada2a7d801 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:12.789848 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b065af5a-f147-4b21-877d-57ada2a7d801 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:12.790347 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-b065af5a-f147-4b21-877d-57ada2a7d801 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:12.800519 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-5cd96d62-9a2f-4d21-9f6f-98395effd25d req-751d3f58-9e61-4cd7-8e53-9a159fbe13a0 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:12.801154 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-5cd96d62-9a2f-4d21-9f6f-98395effd25d req-751d3f58-9e61-4cd7-8e53-9a159fbe13a0 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:12.813157 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-5cd96d62-9a2f-4d21-9f6f-98395effd25d req-751d3f58-9e61-4cd7-8e53-9a159fbe13a0 service nova] Creating event network-changed:575120ce-b83d-4789-a305-68f33b5089bd for instance ced7d1cd-bf5b-49de-8b65-c2f4920242dc on hv-cinder-79819 Aug 24 19:46:12.818446 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-b065af5a-f147-4b21-877d-57ada2a7d801 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Going to try to terminate instance {{(pid=108907) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:46:12.818664 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-5cd96d62-9a2f-4d21-9f6f-98395effd25d req-751d3f58-9e61-4cd7-8e53-9a159fbe13a0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041699 Aug 24 19:46:12.819561 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 648/1313] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:46:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:46:13.200556 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-b065af5a-f147-4b21-877d-57ada2a7d801 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 204 len: 0 microversion: 2.1 time: 0.427020 Aug 24 19:46:13.201145 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 666/1314] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:46:12 2021] DELETE /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 19:46:13.216676 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-679033d7-b2d3-404e-8670-0c2ae43631bf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:46:13.218247 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-679033d7-b2d3-404e-8670-0c2ae43631bf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:46:13.231650 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-679033d7-b2d3-404e-8670-0c2ae43631bf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:13.236088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-679033d7-b2d3-404e-8670-0c2ae43631bf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:13.236088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-679033d7-b2d3-404e-8670-0c2ae43631bf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:13.236088 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-679033d7-b2d3-404e-8670-0c2ae43631bf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:13.478411 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-679033d7-b2d3-404e-8670-0c2ae43631bf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:46:13.486789 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-679033d7-b2d3-404e-8670-0c2ae43631bf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1579 microversion: 2.1 time: 0.278699 Aug 24 19:46:13.487378 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 649/1315] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:46:13 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1579 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:46:14.505360 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7012d616-2282-405f-81c0-ed597074b813 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:46:14.506070 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7012d616-2282-405f-81c0-ed597074b813 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:46:14.511922 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7012d616-2282-405f-81c0-ed597074b813 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:14.512383 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7012d616-2282-405f-81c0-ed597074b813 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:14.513142 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7012d616-2282-405f-81c0-ed597074b813 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:14.513561 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7012d616-2282-405f-81c0-ed597074b813 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:14.633248 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-7012d616-2282-405f-81c0-ed597074b813 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:46:14.640694 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7012d616-2282-405f-81c0-ed597074b813 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1460 microversion: 2.1 time: 0.139275 Aug 24 19:46:14.641263 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 667/1316] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:46:14 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1460 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:46:15.288230 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-83049e0c-5bb3-4cd3-9798-55e76d1b1187 req-e3c0c573-ec92-4ef9-8d7f-a595fdf78059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced7d1cd-bf5b-49de-8b65-c2f4920242dc", "name": "network-vif-deleted", "tag": "575120ce-b83d-4789-a305-68f33b5089bd"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:46:15.288959 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:46:15.288959 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:46:15.295719 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-83049e0c-5bb3-4cd3-9798-55e76d1b1187 req-e3c0c573-ec92-4ef9-8d7f-a595fdf78059 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:15.296156 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-83049e0c-5bb3-4cd3-9798-55e76d1b1187 req-e3c0c573-ec92-4ef9-8d7f-a595fdf78059 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:15.307531 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-83049e0c-5bb3-4cd3-9798-55e76d1b1187 req-e3c0c573-ec92-4ef9-8d7f-a595fdf78059 service nova] Creating event network-vif-deleted:575120ce-b83d-4789-a305-68f33b5089bd for instance ced7d1cd-bf5b-49de-8b65-c2f4920242dc on hv-cinder-79819 Aug 24 19:46:15.312673 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-83049e0c-5bb3-4cd3-9798-55e76d1b1187 req-e3c0c573-ec92-4ef9-8d7f-a595fdf78059 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029056 Aug 24 19:46:15.313276 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 650/1317] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:46:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:46:15.657961 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-bfbf5548-d00b-4ae4-81ff-80766a4bfcbf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:46:15.658600 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-bfbf5548-d00b-4ae4-81ff-80766a4bfcbf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:46:15.665080 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bfbf5548-d00b-4ae4-81ff-80766a4bfcbf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:15.665527 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bfbf5548-d00b-4ae4-81ff-80766a4bfcbf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:15.666318 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bfbf5548-d00b-4ae4-81ff-80766a4bfcbf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:15.666745 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-bfbf5548-d00b-4ae4-81ff-80766a4bfcbf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:15.727449 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-bfbf5548-d00b-4ae4-81ff-80766a4bfcbf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:46:15.734749 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-bfbf5548-d00b-4ae4-81ff-80766a4bfcbf tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 200 len: 1226 microversion: 2.1 time: 0.080658 Aug 24 19:46:15.735316 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 668/1318] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:46:15 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:46:16.752649 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-59292a0d-255b-4f8b-b1c2-425fb2a6442a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:46:16.753408 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-59292a0d-255b-4f8b-b1c2-425fb2a6442a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: ced7d1cd-bf5b-49de-8b65-c2f4920242dc] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:46:16.759943 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-59292a0d-255b-4f8b-b1c2-425fb2a6442a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:16.760408 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-59292a0d-255b-4f8b-b1c2-425fb2a6442a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:16.761165 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-59292a0d-255b-4f8b-b1c2-425fb2a6442a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:16.761590 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-59292a0d-255b-4f8b-b1c2-425fb2a6442a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:16.775017 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-59292a0d-255b-4f8b-b1c2-425fb2a6442a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] HTTP exception thrown: Instance ced7d1cd-bf5b-49de-8b65-c2f4920242dc could not be found. Aug 24 19:46:16.775608 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-59292a0d-255b-4f8b-b1c2-425fb2a6442a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Returning 404 to user: Instance ced7d1cd-bf5b-49de-8b65-c2f4920242dc could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:46:16.776460 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-59292a0d-255b-4f8b-b1c2-425fb2a6442a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc" status: 404 len: 111 microversion: 2.1 time: 0.027862 Aug 24 19:46:16.777012 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 651/1319] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:46:16 2021] GET /compute/v2.1/servers/ced7d1cd-bf5b-49de-8b65-c2f4920242dc => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:46:20.478379 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-8daa9d45-03f4-4357-890e-aeba8f748800 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:46:20.479192 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8daa9d45-03f4-4357-890e-aeba8f748800 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:46:20.485462 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-f48a34f6-887d-4f96-bf93-d955e2bad781 req-2d5cb957-0f40-414d-8b3f-47277aab67bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f21a777-aa5d-4b69-b2dc-fff666007e06", "tag": "e8596897-e25d-45a8-9e90-a10e29373fa7"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:46:20.486367 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8daa9d45-03f4-4357-890e-aeba8f748800 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:20.486367 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8daa9d45-03f4-4357-890e-aeba8f748800 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:20.486960 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8daa9d45-03f4-4357-890e-aeba8f748800 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:20.487139 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:46:20.487139 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:46:20.487423 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-8daa9d45-03f4-4357-890e-aeba8f748800 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:20.495682 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-f48a34f6-887d-4f96-bf93-d955e2bad781 req-2d5cb957-0f40-414d-8b3f-47277aab67bb service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:20.496207 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-f48a34f6-887d-4f96-bf93-d955e2bad781 req-2d5cb957-0f40-414d-8b3f-47277aab67bb service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:20.508169 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-f48a34f6-887d-4f96-bf93-d955e2bad781 req-2d5cb957-0f40-414d-8b3f-47277aab67bb service nova] Creating event network-changed:e8596897-e25d-45a8-9e90-a10e29373fa7 for instance 5f21a777-aa5d-4b69-b2dc-fff666007e06 on hv-cinder-79819 Aug 24 19:46:20.514078 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-f48a34f6-887d-4f96-bf93-d955e2bad781 req-2d5cb957-0f40-414d-8b3f-47277aab67bb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032503 Aug 24 19:46:20.514762 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 652/1320] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:46:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 19:46:20.516843 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-8daa9d45-03f4-4357-890e-aeba8f748800 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Going to try to terminate instance {{(pid=108907) delete /opt/stack/nova/nova/compute/api.py:2574}} Aug 24 19:46:20.812250 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-8daa9d45-03f4-4357-890e-aeba8f748800 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 204 len: 0 microversion: 2.1 time: 0.337297 Aug 24 19:46:20.813068 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 669/1321] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:46:20 2021] DELETE /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 19:46:20.824333 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-dfe875d5-4a4f-4bf9-ba13-1bcf06585a6e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:46:20.825047 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-dfe875d5-4a4f-4bf9-ba13-1bcf06585a6e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:46:20.832086 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfe875d5-4a4f-4bf9-ba13-1bcf06585a6e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:20.832641 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfe875d5-4a4f-4bf9-ba13-1bcf06585a6e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:20.833563 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfe875d5-4a4f-4bf9-ba13-1bcf06585a6e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:20.833888 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-dfe875d5-4a4f-4bf9-ba13-1bcf06585a6e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:21.066417 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.policy [None req-dfe875d5-4a4f-4bf9-ba13-1bcf06585a6e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108908) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:46:21.076332 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-dfe875d5-4a4f-4bf9-ba13-1bcf06585a6e tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1576 microversion: 2.1 time: 0.258411 Aug 24 19:46:21.077187 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 653/1322] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:46:20 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1576 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:46:22.094949 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-249a9cda-e1c2-47be-8220-238d6b84082a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:46:22.095492 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-249a9cda-e1c2-47be-8220-238d6b84082a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:46:22.101650 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-249a9cda-e1c2-47be-8220-238d6b84082a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:22.102088 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-249a9cda-e1c2-47be-8220-238d6b84082a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:22.102849 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-249a9cda-e1c2-47be-8220-238d6b84082a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:22.103269 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-249a9cda-e1c2-47be-8220-238d6b84082a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:22.233591 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-249a9cda-e1c2-47be-8220-238d6b84082a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:46:22.241095 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-249a9cda-e1c2-47be-8220-238d6b84082a tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1458 microversion: 2.1 time: 0.150667 Aug 24 19:46:22.241661 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 670/1323] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:46:22 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1458 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 19:46:22.955479 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [req-6d4d5716-9e72-4ef2-9240-5dd1745c91ab req-0fe69004-b9b4-4994-961d-f9c362ea95d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f21a777-aa5d-4b69-b2dc-fff666007e06", "name": "network-vif-deleted", "tag": "e8596897-e25d-45a8-9e90-a10e29373fa7"}]} {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 19:46:22.957106 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 19:46:22.957106 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: warnings.warn(msg) Aug 24 19:46:22.965428 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-6d4d5716-9e72-4ef2-9240-5dd1745c91ab req-0fe69004-b9b4-4994-961d-f9c362ea95d1 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:22.966005 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [req-6d4d5716-9e72-4ef2-9240-5dd1745c91ab req-0fe69004-b9b4-4994-961d-f9c362ea95d1 service nova] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:22.978740 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.compute.server_external_events [req-6d4d5716-9e72-4ef2-9240-5dd1745c91ab req-0fe69004-b9b4-4994-961d-f9c362ea95d1 service nova] Creating event network-vif-deleted:e8596897-e25d-45a8-9e90-a10e29373fa7 for instance 5f21a777-aa5d-4b69-b2dc-fff666007e06 on hv-cinder-79819 Aug 24 19:46:22.983668 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [req-6d4d5716-9e72-4ef2-9240-5dd1745c91ab req-0fe69004-b9b4-4994-961d-f9c362ea95d1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031951 Aug 24 19:46:22.984258 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 654/1324] 10.222.0.59 () {64 vars in 1318 bytes} [Tue Aug 24 19:46:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 19:46:23.258134 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-6c626fbf-f400-4202-a78c-131f322ef978 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:46:23.259335 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-6c626fbf-f400-4202-a78c-131f322ef978 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:46:23.265472 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6c626fbf-f400-4202-a78c-131f322ef978 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:23.265914 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6c626fbf-f400-4202-a78c-131f322ef978 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:23.266731 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6c626fbf-f400-4202-a78c-131f322ef978 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:23.267151 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-6c626fbf-f400-4202-a78c-131f322ef978 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:23.330827 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.policy [None req-6c626fbf-f400-4202-a78c-131f322ef978 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6000c097b514930871a9f590134104e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2be3a7831b54615af1b92b62f673658', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108907) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 19:46:23.338825 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-6c626fbf-f400-4202-a78c-131f322ef978 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 200 len: 1225 microversion: 2.1 time: 0.084538 Aug 24 19:46:23.339418 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 671/1325] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:46:23 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 19:46:24.356550 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3459e54a-60ad-44e1-853b-90078d04d9c4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:46:24.357239 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-3459e54a-60ad-44e1-853b-90078d04d9c4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 5f21a777-aa5d-4b69-b2dc-fff666007e06] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:46:24.363458 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3459e54a-60ad-44e1-853b-90078d04d9c4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:24.363900 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3459e54a-60ad-44e1-853b-90078d04d9c4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:24.364854 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3459e54a-60ad-44e1-853b-90078d04d9c4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:24.365112 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-3459e54a-60ad-44e1-853b-90078d04d9c4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:24.378924 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-3459e54a-60ad-44e1-853b-90078d04d9c4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] HTTP exception thrown: Instance 5f21a777-aa5d-4b69-b2dc-fff666007e06 could not be found. Aug 24 19:46:24.379518 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-3459e54a-60ad-44e1-853b-90078d04d9c4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Returning 404 to user: Instance 5f21a777-aa5d-4b69-b2dc-fff666007e06 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:46:24.380369 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-3459e54a-60ad-44e1-853b-90078d04d9c4 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06" status: 404 len: 111 microversion: 2.1 time: 0.027961 Aug 24 19:46:24.380906 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 655/1326] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:46:24 2021] GET /compute/v2.1/servers/5f21a777-aa5d-4b69-b2dc-fff666007e06 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:46:24.945093 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7a2826bc-5c14-470b-b492-32202013c000 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:46:24.945669 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.compute.api [None req-7a2826bc-5c14-470b-b492-32202013c000 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108907) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:46:24.952315 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a2826bc-5c14-470b-b492-32202013c000 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:24.952753 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a2826bc-5c14-470b-b492-32202013c000 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:24.953521 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a2826bc-5c14-470b-b492-32202013c000 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:24.953943 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG oslo_concurrency.lockutils [None req-7a2826bc-5c14-470b-b492-32202013c000 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108907) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:24.969780 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.wsgi [None req-7a2826bc-5c14-470b-b492-32202013c000 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] HTTP exception thrown: Instance 6ee58430-380a-4eb6-8413-5259275420f4 could not be found. Aug 24 19:46:24.970376 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-7a2826bc-5c14-470b-b492-32202013c000 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Returning 404 to user: Instance 6ee58430-380a-4eb6-8413-5259275420f4 could not be found. {{(pid=108907) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:46:24.971215 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-7a2826bc-5c14-470b-b492-32202013c000 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 404 len: 111 microversion: 2.1 time: 0.029845 Aug 24 19:46:24.971787 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 672/1327] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Aug 24 19:46:24 2021] DELETE /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:46:24.980077 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-cfcbb489-b0df-479f-8b80-9e360a13e994 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '>' {{(pid=108908) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:46:24.980721 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.compute.api [None req-cfcbb489-b0df-479f-8b80-9e360a13e994 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] [instance: 6ee58430-380a-4eb6-8413-5259275420f4] Fetching instance by UUID {{(pid=108908) get /opt/stack/nova/nova/compute/api.py:2825}} Aug 24 19:46:24.987086 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cfcbb489-b0df-479f-8b80-9e360a13e994 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:24.987531 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cfcbb489-b0df-479f-8b80-9e360a13e994 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:24.988351 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cfcbb489-b0df-479f-8b80-9e360a13e994 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 24 19:46:24.988787 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG oslo_concurrency.lockutils [None req-cfcbb489-b0df-479f-8b80-9e360a13e994 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Lock "9aa87762-c658-4c0f-874d-57bbc1863216" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108908) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 24 19:46:25.003344 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.wsgi [None req-cfcbb489-b0df-479f-8b80-9e360a13e994 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] HTTP exception thrown: Instance 6ee58430-380a-4eb6-8413-5259275420f4 could not be found. Aug 24 19:46:25.003928 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: DEBUG nova.api.openstack.wsgi [None req-cfcbb489-b0df-479f-8b80-9e360a13e994 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Returning 404 to user: Instance 6ee58430-380a-4eb6-8413-5259275420f4 could not be found. {{(pid=108908) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 24 19:46:25.004814 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO nova.api.openstack.requestlog [None req-cfcbb489-b0df-479f-8b80-9e360a13e994 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4" status: 404 len: 111 microversion: 2.1 time: 0.028525 Aug 24 19:46:25.005371 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: [pid: 108908|app: 0|req: 656/1328] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Aug 24 19:46:24 2021] GET /compute/v2.1/servers/6ee58430-380a-4eb6-8413-5259275420f4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 19:46:26.567711 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: DEBUG nova.api.openstack.wsgi [None req-191355cd-33ce-434b-af44-3203bacccda9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] Calling method '.version_select at 0x7f8df737a670>' {{(pid=108907) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 19:46:26.669276 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO nova.api.openstack.requestlog [None req-191355cd-33ce-434b-af44-3203bacccda9 tempest-TestVolumeBootPattern-1603131644 tempest-TestVolumeBootPattern-1603131644-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1536662292" status: 202 len: 0 microversion: 2.1 time: 0.105515 Aug 24 19:46:26.669973 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: [pid: 108907|app: 0|req: 673/1329] 10.222.0.59 () {58 vars in 1263 bytes} [Tue Aug 24 19:46:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1536662292 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 19:47:48.823573 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 19:47:48.824231 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: Tue Aug 24 19:47:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 19:48:26.312714 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 19:48:26.313394 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: Tue Aug 24 19:48:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 19:48:48.492829 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 19:48:48.493522 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: Tue Aug 24 19:48:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 19:48:50.972233 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 19:48:50.972825 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: Tue Aug 24 19:48:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 19:50:06.351534 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 19:50:06.352195 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: Tue Aug 24 19:50:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 19:51:08.841266 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 19:51:08.841990 dv-cinder-798198-3-iscsi devstack@n-api.service[108908]: Tue Aug 24 19:51:08 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 19:51:46.340348 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 19:51:46.340976 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: Tue Aug 24 19:51:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 19:51:49.647257 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 19:51:49.647828 dv-cinder-798198-3-iscsi devstack@n-api.service[108907]: Tue Aug 24 19:51:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!